Skip to content

perf[array]: add the SimplifyCache to optimize#7948

Merged
joseph-isaacs merged 4 commits into
developfrom
ji/fix-try-opt-bench
May 15, 2026
Merged

perf[array]: add the SimplifyCache to optimize#7948
joseph-isaacs merged 4 commits into
developfrom
ji/fix-try-opt-bench

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented May 15, 2026

Cache optimisations to array in try_optimize on the way down

@joseph-isaacs
perf[array]: add the SimplifyCache to optimize
238e467 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs marked this pull request as ready for review May 15, 2026 14:28
@joseph-isaacs
fix
a9a3a2c 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
fix
ea3e0db 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) May 15, 2026 14:32
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 15, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 15, 2026
@joseph-isaacs joseph-isaacs added action/benchmark Trigger full benchmarks to run on this PR changelog/performance A performance improvement labels May 15, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 15, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 15, 2026 •
edited
Loading

Merging this PR will improve performance by 12.93%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 4 improved benchmarks
✅ 1212 untouched benchmarks
🆕 1 new benchmark

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation encode_varbin[(1000, 2)] 169 µs 148.9 µs +13.51%
⚡ Simulation encode_varbin[(1000, 32)] 176 µs 155.5 µs +13.23%
⚡ Simulation encode_varbin[(1000, 4)] 169.9 µs 149.3 µs +13.75%
⚡ Simulation encode_varbin[(1000, 8)] 166.8 µs 149.9 µs +11.24%
🆕 Simulation optimize_or_chain[200] N/A 440.3 µs N/A

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ji/fix-try-opt-bench (48e2902) with develop (13c06b8)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ea3e0db 1 Explore Profiling Data

Powered by Polar Signals Cloud

@joseph-isaacs
fix
48e2902 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.980x ➖

datafusion / vortex-file-compressed (0.980x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123562948 123433908 1.00
polarsignals_q01/datafusion:vortex-file-compressed 264518155 283097896 0.93
polarsignals_q02/datafusion:vortex-file-compressed 22248270 23594690 0.94
polarsignals_q03/datafusion:vortex-file-compressed 272165153 273183354 1.00
polarsignals_q04/datafusion:vortex-file-compressed 11318473 11270653 1.00
polarsignals_q05/datafusion:vortex-file-compressed 15226695 14973227 1.02
polarsignals_q06/datafusion:vortex-file-compressed 18449849 18954834 0.97
polarsignals_q07/datafusion:vortex-file-compressed 13581271 14017078 0.97
polarsignals_q08/datafusion:vortex-file-compressed 400024497 408276530 0.98
polarsignals_q09/datafusion:vortex-file-compressed 11127676 11342183 0.98

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.5%
Vortex (geomean): 0.971x ➖
Parquet (geomean): 0.948x ➖
Shifts: Parquet (control) -5.2% · Median polish -2.4%

datafusion / vortex-file-compressed (0.976x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5222005 5378060 0.97
fineweb_q01/datafusion:vortex-file-compressed 19307224 21131351 0.91
fineweb_q02/datafusion:vortex-file-compressed 20482971 21426226 0.96
fineweb_q03/datafusion:vortex-file-compressed 81291280 76872642 1.06
fineweb_q04/datafusion:vortex-file-compressed 218284228 226421231 0.96
fineweb_q05/datafusion:vortex-file-compressed 209077969 210527519 0.99
fineweb_q06/datafusion:vortex-file-compressed 50019808 50391022 0.99
fineweb_q07/datafusion:vortex-file-compressed 54903564 54005054 1.02
fineweb_q08/datafusion:vortex-file-compressed 20007302 21598055 0.93
datafusion / vortex-compact (0.983x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5428436 5597769 0.97
fineweb_q01/datafusion:vortex-compact 91574816 89135763 1.03
fineweb_q02/datafusion:vortex-compact 101227891 102517141 0.99
fineweb_q03/datafusion:vortex-compact 864915753 858097476 1.01
fineweb_q04/datafusion:vortex-compact 900747543 920166192 0.98
fineweb_q05/datafusion:vortex-compact 805921262 817933254 0.99
fineweb_q06/datafusion:vortex-compact 458434496 471693031 0.97
fineweb_q07/datafusion:vortex-compact 473760354 499799925 0.95
fineweb_q08/datafusion:vortex-compact 16773941 17303690 0.97
datafusion / parquet (0.971x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6507137 6910075 0.94
fineweb_q01/datafusion:parquet 283249576 294005048 0.96
fineweb_q02/datafusion:parquet 284681798 304467973 0.94
fineweb_q03/datafusion:parquet 282813454 286811655 0.99
fineweb_q04/datafusion:parquet 297878593 295132293 1.01
fineweb_q05/datafusion:parquet 290655719 295009152 0.99
fineweb_q06/datafusion:parquet 279887914 296568688 0.94
fineweb_q07/datafusion:parquet 276384547 282423156 0.98
fineweb_q08/datafusion:parquet 274618306 274461956 1.00
duckdb / vortex-file-compressed (0.959x ➖, 2↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3173919 3630235 0.87
fineweb_q01/duckdb:vortex-file-compressed 21061417 23139339 0.91
fineweb_q02/duckdb:vortex-file-compressed 21829232 23802695 0.92
fineweb_q03/duckdb:vortex-file-compressed 115332957 118389098 0.97
fineweb_q04/duckdb:vortex-file-compressed 218509294 217831946 1.00
fineweb_q05/duckdb:vortex-file-compressed 208758656 208753485 1.00
fineweb_q06/duckdb:vortex-file-compressed 🚀 49902926 55718381 0.90
fineweb_q07/duckdb:vortex-file-compressed 54507809 55050423 0.99
fineweb_q08/duckdb:vortex-file-compressed 23581612 21698326 1.09
duckdb / vortex-compact (0.968x ➖, 1↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3808161 4095627 0.93
fineweb_q01/duckdb:vortex-compact 🚀 103295203 117243687 0.88
fineweb_q02/duckdb:vortex-compact 116041990 114898303 1.01
fineweb_q03/duckdb:vortex-compact 844274306 870389067 0.97
fineweb_q04/duckdb:vortex-compact 897623529 914889492 0.98
fineweb_q05/duckdb:vortex-compact 797748869 822423094 0.97
fineweb_q06/duckdb:vortex-compact 461790832 476361168 0.97
fineweb_q07/duckdb:vortex-compact 473992861 486752128 0.97
fineweb_q08/duckdb:vortex-compact 20873512 20182391 1.03
duckdb / parquet (0.926x ➖, 1↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30685364 32650546 0.94
fineweb_q01/duckdb:parquet 81424022 89976510 0.90
fineweb_q02/duckdb:parquet 83299976 89343564 0.93
fineweb_q03/duckdb:parquet 305347250 318385052 0.96
fineweb_q04/duckdb:parquet 436036205 447816050 0.97
fineweb_q05/duckdb:parquet 408584144 421671065 0.97
fineweb_q06/duckdb:parquet 196221837 205327600 0.96
fineweb_q07/duckdb:parquet 207070593 216108588 0.96
fineweb_q08/duckdb:parquet 🚀 28366965 37407585 0.76
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -3.0% -5.9% +3.1% +57.0% ➖ noise
0 datafusion:vortex-file-compressed -2.9% -5.9% +3.2% +50.6% ➖ noise
0 duckdb:vortex-compact -7.0% -5.9% -1.2% +49.7% ➖ noise
0 duckdb:vortex-file-compressed -12.6% -5.9% -7.1% +85.8% ➖ noise
1 datafusion:vortex-compact +2.7% -6.6% +10.0% +10.4% ➖ noise
1 datafusion:vortex-file-compressed -8.6% -6.6% -2.1% +21.5% ➖ noise
1 duckdb:vortex-compact -11.9% -6.6% -5.6% +23.7% ➖ noise
1 duckdb:vortex-file-compressed -9.0% -6.6% -2.5% +66.0% ➖ noise
2 datafusion:vortex-compact -1.3% -6.6% +5.8% +16.4% ➖ noise
2 datafusion:vortex-file-compressed -4.4% -6.6% +2.4% +10.4% ➖ noise
2 duckdb:vortex-compact +1.0% -6.6% +8.2% +18.9% ➖ noise
2 duckdb:vortex-file-compressed -8.3% -6.6% -1.8% +10.4% ➖ noise
3 datafusion:vortex-compact +0.8% -2.8% +3.6% +10.4% ➖ noise
3 datafusion:vortex-file-compressed +5.7% -2.8% +8.7% +24.0% ➖ noise
3 duckdb:vortex-compact -3.0% -2.8% -0.3% +10.4% ➖ noise
3 duckdb:vortex-file-compressed -2.6% -2.8% +0.2% +31.7% ➖ noise
4 datafusion:vortex-compact -2.1% -0.9% -1.3% +10.4% ➖ noise
4 datafusion:vortex-file-compressed -3.6% -0.9% -2.8% +10.4% ➖ noise
4 duckdb:vortex-compact -1.9% -0.9% -1.0% +10.4% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -0.9% +1.2% +10.4% ➖ noise
5 datafusion:vortex-compact -1.5% -2.3% +0.8% +10.4% ➖ noise
5 datafusion:vortex-file-compressed -0.7% -2.3% +1.6% +10.4% ➖ noise
5 duckdb:vortex-compact -3.0% -2.3% -0.7% +10.4% ➖ noise
5 duckdb:vortex-file-compressed +0.0% -2.3% +2.3% +10.4% ➖ noise
6 datafusion:vortex-compact -2.8% -5.0% +2.3% +10.4% ➖ noise
6 datafusion:vortex-file-compressed -0.7% -5.0% +4.5% +10.4% ➖ noise
6 duckdb:vortex-compact -3.1% -5.0% +2.1% +10.4% ➖ noise
6 duckdb:vortex-file-compressed -10.4% -5.0% -5.7% +10.4% ➖ noise
7 datafusion:vortex-compact -5.2% -3.2% -2.1% +10.4% ➖ noise
7 datafusion:vortex-file-compressed +1.7% -3.2% +5.0% +10.4% ➖ noise
7 duckdb:vortex-compact -2.6% -3.2% +0.6% +10.4% ➖ noise
7 duckdb:vortex-file-compressed -1.0% -3.2% +2.3% +19.4% ➖ noise
8 datafusion:vortex-compact -3.1% -12.9% +11.3% +12.3% ➖ noise
8 datafusion:vortex-file-compressed -7.4% -12.9% +6.3% +10.4% ➖ noise
8 duckdb:vortex-compact +3.4% -12.9% +18.7% +34.0% ➖ noise
8 duckdb:vortex-file-compressed +8.7% -12.9% +24.8% +10.4% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.4%
Vortex (geomean): 1.167x ❌
Parquet (geomean): 1.092x ➖
Shifts: Parquet (control) +9.2% · Median polish +16.7%

datafusion / vortex-file-compressed (1.181x ❌, 0↑ 18↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 62296958 50674516 1.23
tpch_q02/datafusion:vortex-file-compressed 🚨 25765460 21816647 1.18
tpch_q03/datafusion:vortex-file-compressed 🚨 35407124 28577572 1.24
tpch_q04/datafusion:vortex-file-compressed 🚨 26530803 20287128 1.31
tpch_q05/datafusion:vortex-file-compressed 🚨 61970643 47640608 1.30
tpch_q06/datafusion:vortex-file-compressed 🚨 12934151 11524460 1.12
tpch_q07/datafusion:vortex-file-compressed 🚨 67924777 53999251 1.26
tpch_q08/datafusion:vortex-file-compressed 🚨 45956745 39764879 1.16
tpch_q09/datafusion:vortex-file-compressed 🚨 62458305 51651134 1.21
tpch_q10/datafusion:vortex-file-compressed 🚨 48237067 39143763 1.23
tpch_q11/datafusion:vortex-file-compressed 🚨 18686911 15757582 1.19
tpch_q12/datafusion:vortex-file-compressed 🚨 28375398 24960365 1.14
tpch_q13/datafusion:vortex-file-compressed 🚨 29609647 25203323 1.17
tpch_q14/datafusion:vortex-file-compressed 18411749 16887153 1.09
tpch_q15/datafusion:vortex-file-compressed 28016052 26122187 1.07
tpch_q16/datafusion:vortex-file-compressed 🚨 21723371 19693482 1.10
tpch_q17/datafusion:vortex-file-compressed 🚨 85665071 67126178 1.28
tpch_q18/datafusion:vortex-file-compressed 🚨 101789654 79887949 1.27
tpch_q19/datafusion:vortex-file-compressed 22206734 22819357 0.97
tpch_q20/datafusion:vortex-file-compressed 🚨 36831237 30925053 1.19
tpch_q21/datafusion:vortex-file-compressed 🚨 89465821 71289515 1.25
tpch_q22/datafusion:vortex-file-compressed 13645849 12586945 1.08
datafusion / vortex-compact (1.174x ❌, 0↑ 20↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 69921469 58418089 1.20
tpch_q02/datafusion:vortex-compact 🚨 30094749 25421649 1.18
tpch_q03/datafusion:vortex-compact 🚨 35213552 29212187 1.21
tpch_q04/datafusion:vortex-compact 🚨 27566782 23130213 1.19
tpch_q05/datafusion:vortex-compact 🚨 65219720 50231046 1.30
tpch_q06/datafusion:vortex-compact 14506205 14021285 1.03
tpch_q07/datafusion:vortex-compact 🚨 71110803 58383092 1.22
tpch_q08/datafusion:vortex-compact 🚨 51476492 42796367 1.20
tpch_q09/datafusion:vortex-compact 🚨 66958323 54630010 1.23
tpch_q10/datafusion:vortex-compact 🚨 53484808 46013928 1.16
tpch_q11/datafusion:vortex-compact 🚨 19137012 16862197 1.13
tpch_q12/datafusion:vortex-compact 🚨 35105935 31138502 1.13
tpch_q13/datafusion:vortex-compact 🚨 36918830 32110837 1.15
tpch_q14/datafusion:vortex-compact 🚨 22164286 19630833 1.13
tpch_q15/datafusion:vortex-compact 35110365 32167959 1.09
tpch_q16/datafusion:vortex-compact 🚨 27231046 23773105 1.15
tpch_q17/datafusion:vortex-compact 🚨 85629752 68699770 1.25
tpch_q18/datafusion:vortex-compact 🚨 107310978 82839821 1.30
tpch_q19/datafusion:vortex-compact 🚨 33664327 30525307 1.10
tpch_q20/datafusion:vortex-compact 🚨 39717347 34504257 1.15
tpch_q21/datafusion:vortex-compact 🚨 93750559 75225860 1.25
tpch_q22/datafusion:vortex-compact 🚨 14506743 12893342 1.13
datafusion / parquet (1.102x ❌, 1↑ 15↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 105464499 133274685 0.79
tpch_q02/datafusion:parquet 🚨 70373937 60015613 1.17
tpch_q03/datafusion:parquet 77627240 71329091 1.09
tpch_q04/datafusion:parquet 47672941 43784724 1.09
tpch_q05/datafusion:parquet 🚨 104498092 92127636 1.13
tpch_q06/datafusion:parquet 42048538 39663164 1.06
tpch_q07/datafusion:parquet 🚨 117772568 105864576 1.11
tpch_q08/datafusion:parquet 97151606 100300461 0.97
tpch_q09/datafusion:parquet 🚨 141755258 127285754 1.11
tpch_q10/datafusion:parquet 🚨 122607843 109199179 1.12
tpch_q11/datafusion:parquet 44754347 40720651 1.10
tpch_q12/datafusion:parquet 🚨 94542658 82502985 1.15
tpch_q13/datafusion:parquet 🚨 220686349 198106955 1.11
tpch_q14/datafusion:parquet 🚨 51503769 44541893 1.16
tpch_q15/datafusion:parquet 🚨 67614140 58476883 1.16
tpch_q16/datafusion:parquet 🚨 46789800 38750046 1.21
tpch_q17/datafusion:parquet 🚨 159196741 130947649 1.22
tpch_q18/datafusion:parquet 🚨 186019886 163769814 1.14
tpch_q19/datafusion:parquet 🚨 76529098 66782889 1.15
tpch_q20/datafusion:parquet 74089388 70018896 1.06
tpch_q21/datafusion:parquet 🚨 145829499 129933551 1.12
tpch_q22/datafusion:parquet 🚨 33918496 30417618 1.12
datafusion / arrow (1.248x ❌, 0↑ 21↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 71073970 51767963 1.37
tpch_q02/datafusion:arrow 20767852 18902463 1.10
tpch_q03/datafusion:arrow 🚨 38151681 29910616 1.28
tpch_q04/datafusion:arrow 🚨 32455294 25059724 1.30
tpch_q05/datafusion:arrow 🚨 94137704 73697786 1.28
tpch_q06/datafusion:arrow 🚨 26404266 19281421 1.37
tpch_q07/datafusion:arrow 🚨 116939421 98816192 1.18
tpch_q08/datafusion:arrow 🚨 54224002 40455018 1.34
tpch_q09/datafusion:arrow 🚨 77364452 64079014 1.21
tpch_q10/datafusion:arrow 🚨 57450555 48489475 1.18
tpch_q11/datafusion:arrow 🚨 10286022 9268629 1.11
tpch_q12/datafusion:arrow 🚨 62833224 50039806 1.26
tpch_q13/datafusion:arrow 🚨 53661950 46390037 1.16
tpch_q14/datafusion:arrow 🚨 28079638 21269359 1.32
tpch_q15/datafusion:arrow 🚨 51107591 41130561 1.24
tpch_q16/datafusion:arrow 🚨 21132367 18918211 1.12
tpch_q17/datafusion:arrow 🚨 85126551 67051981 1.27
tpch_q18/datafusion:arrow 🚨 171851546 135970248 1.26
tpch_q19/datafusion:arrow 🚨 52392074 34823195 1.50
tpch_q20/datafusion:arrow 🚨 44461247 33934887 1.31
tpch_q21/datafusion:arrow 🚨 186254833 152958160 1.22
tpch_q22/datafusion:arrow 🚨 20560112 17608970 1.17
duckdb / vortex-file-compressed (1.163x ❌, 0↑ 19↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 35027059 31536945 1.11
tpch_q02/duckdb:vortex-file-compressed 26340846 24463584 1.08
tpch_q03/duckdb:vortex-file-compressed 🚨 33947785 28762471 1.18
tpch_q04/duckdb:vortex-file-compressed 🚨 34285005 28561544 1.20
tpch_q05/duckdb:vortex-file-compressed 36673081 36312567 1.01
tpch_q06/duckdb:vortex-file-compressed 🚨 10007200 8309728 1.20
tpch_q07/duckdb:vortex-file-compressed 🚨 40355107 34389011 1.17
tpch_q08/duckdb:vortex-file-compressed 🚨 40892091 35127747 1.16
tpch_q09/duckdb:vortex-file-compressed 🚨 84902852 60668435 1.40
tpch_q10/duckdb:vortex-file-compressed 39251949 41083391 0.96
tpch_q11/duckdb:vortex-file-compressed 🚨 16541603 14016854 1.18
tpch_q12/duckdb:vortex-file-compressed 🚨 24012441 21182263 1.13
tpch_q13/duckdb:vortex-file-compressed 🚨 40814408 35578489 1.15
tpch_q14/duckdb:vortex-file-compressed 🚨 23649828 19868363 1.19
tpch_q15/duckdb:vortex-file-compressed 🚨 19219045 16181589 1.19
tpch_q16/duckdb:vortex-file-compressed 🚨 30151498 26425025 1.14
tpch_q17/duckdb:vortex-file-compressed 🚨 28371971 24628715 1.15
tpch_q18/duckdb:vortex-file-compressed 🚨 57692995 49384998 1.17
tpch_q19/duckdb:vortex-file-compressed 🚨 34090709 28081626 1.21
tpch_q20/duckdb:vortex-file-compressed 🚨 36868865 33075709 1.11
tpch_q21/duckdb:vortex-file-compressed 🚨 123174366 95447228 1.29
tpch_q22/duckdb:vortex-file-compressed 🚨 19091342 15040539 1.27
duckdb / vortex-compact (1.151x ❌, 0↑ 15↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 42576910 38423499 1.11
tpch_q02/duckdb:vortex-compact 35244804 35711461 0.99
tpch_q03/duckdb:vortex-compact 🚨 36259544 32669950 1.11
tpch_q04/duckdb:vortex-compact 🚨 39538005 30586343 1.29
tpch_q05/duckdb:vortex-compact 39263211 41272099 0.95
tpch_q06/duckdb:vortex-compact 🚨 14913096 10803110 1.38
tpch_q07/duckdb:vortex-compact 🚨 46722955 40951393 1.14
tpch_q08/duckdb:vortex-compact 🚨 46888981 40164399 1.17
tpch_q09/duckdb:vortex-compact 🚨 92208694 70063686 1.32
tpch_q10/duckdb:vortex-compact 43351071 46283011 0.94
tpch_q11/duckdb:vortex-compact 18957256 18915011 1.00
tpch_q12/duckdb:vortex-compact 🚨 38885374 29036102 1.34
tpch_q13/duckdb:vortex-compact 🚨 50048920 43478076 1.15
tpch_q14/duckdb:vortex-compact 🚨 31543897 26050758 1.21
tpch_q15/duckdb:vortex-compact 🚨 22766979 19271468 1.18
tpch_q16/duckdb:vortex-compact 🚨 37636977 31031548 1.21
tpch_q17/duckdb:vortex-compact 32741056 30125422 1.09
tpch_q18/duckdb:vortex-compact 56269516 52181999 1.08
tpch_q19/duckdb:vortex-compact 🚨 39610922 31954289 1.24
tpch_q20/duckdb:vortex-compact 43816699 42999584 1.02
tpch_q21/duckdb:vortex-compact 🚨 129767988 98126450 1.32
tpch_q22/duckdb:vortex-compact 🚨 20986430 16993063 1.23
duckdb / parquet (1.082x ➖, 0↑ 7↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77709788 76188930 1.02
tpch_q02/duckdb:parquet 41590708 38593012 1.08
tpch_q03/duckdb:parquet 73478149 68928770 1.07
tpch_q04/duckdb:parquet 49244845 46797084 1.05
tpch_q05/duckdb:parquet 70383262 65331915 1.08
tpch_q06/duckdb:parquet 🚨 24383558 20139992 1.21
tpch_q07/duckdb:parquet 🚨 76265686 66513690 1.15
tpch_q08/duckdb:parquet 85890476 79855687 1.08
tpch_q09/duckdb:parquet 🚨 147238973 131522941 1.12
tpch_q10/duckdb:parquet 132850626 127675889 1.04
tpch_q11/duckdb:parquet 22884820 20812192 1.10
tpch_q12/duckdb:parquet 47994015 45421626 1.06
tpch_q13/duckdb:parquet 🚨 283139458 247966187 1.14
tpch_q14/duckdb:parquet 51876239 49115264 1.06
tpch_q15/duckdb:parquet 25431700 24237060 1.05
tpch_q16/duckdb:parquet 🚨 60624766 54795827 1.11
tpch_q17/duckdb:parquet 51740368 51645039 1.00
tpch_q18/duckdb:parquet 114863418 109817791 1.05
tpch_q19/duckdb:parquet 🚨 75134195 67390527 1.11
tpch_q20/duckdb:parquet 66470712 62264003 1.07
tpch_q21/duckdb:parquet 🚨 187980363 163034486 1.15
tpch_q22/duckdb:parquet 54832864 51824145 1.06
duckdb / duckdb (1.127x ❌, 0↑ 17↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17467537 15905164 1.10
tpch_q02/duckdb:duckdb 🚨 14362857 12876762 1.12
tpch_q03/duckdb:duckdb 🚨 21574688 19038306 1.13
tpch_q04/duckdb:duckdb 🚨 21297221 19305002 1.10
tpch_q05/duckdb:duckdb 🚨 22767211 19541756 1.17
tpch_q06/duckdb:duckdb 🚨 5917608 5242312 1.13
tpch_q07/duckdb:duckdb 🚨 25522526 22276977 1.15
tpch_q08/duckdb:duckdb 🚨 23269625 20503219 1.13
tpch_q09/duckdb:duckdb 🚨 65046255 54619296 1.19
tpch_q10/duckdb:duckdb 🚨 49592715 42982189 1.15
tpch_q11/duckdb:duckdb 🚨 6838222 5676252 1.20
tpch_q12/duckdb:duckdb 🚨 15391772 13489059 1.14
tpch_q13/duckdb:duckdb 🚨 42233003 37819291 1.12
tpch_q14/duckdb:duckdb 18786032 17859510 1.05
tpch_q15/duckdb:duckdb 12877576 12436070 1.04
tpch_q16/duckdb:duckdb 🚨 25943207 22842024 1.14
tpch_q17/duckdb:duckdb 🚨 15636537 13518200 1.16
tpch_q18/duckdb:duckdb 🚨 42258824 38358889 1.10
tpch_q19/duckdb:duckdb 🚨 30383660 26051353 1.17
tpch_q20/duckdb:duckdb 24511968 22582821 1.09
tpch_q21/duckdb:duckdb 🚨 65459856 55696118 1.18
tpch_q22/duckdb:duckdb 26332105 24581854 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +37.3% -10.2% +52.8% +20.0% 🚨 regression
1 datafusion:vortex-compact +19.7% -10.2% +33.2% +19.0% 🚨 regression
1 datafusion:vortex-file-compressed +22.9% -10.2% +36.8% +18.1% 🚨 regression
1 duckdb:duckdb +9.8% -10.2% +22.2% +17.7% 🚨 regression
1 duckdb:vortex-compact +10.8% -10.2% +23.3% +18.6% 🚨 regression
1 duckdb:vortex-file-compressed +11.1% -10.2% +23.6% +20.4% 🚨 regression
2 datafusion:arrow +9.9% +12.4% -2.3% +14.2% ➖ noise
2 datafusion:vortex-compact +18.4% +12.4% +5.3% +14.2% ➖ noise
2 datafusion:vortex-file-compressed +18.1% +12.4% +5.1% +14.2% ➖ noise
2 duckdb:duckdb +11.5% +12.4% -0.8% +14.2% ➖ noise
2 duckdb:vortex-compact -1.3% +12.4% -12.2% +14.2% ➖ noise
2 duckdb:vortex-file-compressed +7.7% +12.4% -4.2% +14.2% ➖ noise
3 datafusion:arrow +27.6% +7.7% +18.4% +14.2% 🚨 regression
3 datafusion:vortex-compact +20.5% +7.7% +11.9% +14.2% ➖ noise
3 datafusion:vortex-file-compressed +23.9% +7.7% +15.0% +14.2% 🚨 regression
3 duckdb:duckdb +13.3% +7.7% +5.2% +14.2% ➖ noise
3 duckdb:vortex-compact +11.0% +7.7% +3.0% +14.2% ➖ noise
3 duckdb:vortex-file-compressed +18.0% +7.7% +9.6% +14.2% ➖ noise
4 datafusion:arrow +29.5% +7.0% +21.0% +14.2% 🚨 regression
4 datafusion:vortex-compact +19.2% +7.0% +11.3% +14.2% ➖ noise
4 datafusion:vortex-file-compressed +30.8% +7.0% +22.2% +14.2% 🚨 regression
4 duckdb:duckdb +10.3% +7.0% +3.1% +14.2% ➖ noise
4 duckdb:vortex-compact +29.3% +7.0% +20.8% +14.2% 🚨 regression
4 duckdb:vortex-file-compressed +20.0% +7.0% +12.1% +14.2% ➖ noise
5 datafusion:arrow +27.7% +10.5% +15.6% +14.2% 🚨 regression
5 datafusion:vortex-compact +29.8% +10.5% +17.5% +14.2% 🚨 regression
5 datafusion:vortex-file-compressed +30.1% +10.5% +17.7% +14.2% 🚨 regression
5 duckdb:duckdb +16.5% +10.5% +5.4% +14.2% ➖ noise
5 duckdb:vortex-compact -4.9% +10.5% -13.9% +14.2% ✅ faster
5 duckdb:vortex-file-compressed +1.0% +10.5% -8.6% +14.2% ➖ noise
6 datafusion:arrow +36.9% +13.3% +20.9% +16.3% 🚨 regression
6 datafusion:vortex-compact +3.5% +13.3% -8.7% +16.0% ➖ noise
6 datafusion:vortex-file-compressed +12.2% +13.3% -0.9% +17.6% ➖ noise
6 duckdb:duckdb +12.9% +13.3% -0.4% +16.6% ➖ noise
6 duckdb:vortex-compact +38.0% +13.3% +21.8% +20.4% 🚨 regression
6 duckdb:vortex-file-compressed +20.4% +13.3% +6.3% +15.3% ➖ noise
7 datafusion:arrow +18.3% +12.9% +4.8% +14.2% ➖ noise
7 datafusion:vortex-compact +21.8% +12.9% +7.8% +14.2% ➖ noise
7 datafusion:vortex-file-compressed +25.8% +12.9% +11.4% +14.2% ➖ noise
7 duckdb:duckdb +14.6% +12.9% +1.4% +14.2% ➖ noise
7 duckdb:vortex-compact +14.1% +12.9% +1.0% +14.2% ➖ noise
7 duckdb:vortex-file-compressed +17.3% +12.9% +3.9% +14.2% ➖ noise
8 datafusion:arrow +34.0% +2.1% +31.3% +14.2% 🚨 regression
8 datafusion:vortex-compact +20.3% +2.1% +17.8% +14.2% 🚨 regression
8 datafusion:vortex-file-compressed +15.6% +2.1% +13.2% +14.2% ➖ noise
8 duckdb:duckdb +13.5% +2.1% +11.2% +14.2% ➖ noise
8 duckdb:vortex-compact +16.7% +2.1% +14.4% +14.2% 🚨 regression
8 duckdb:vortex-file-compressed +16.4% +2.1% +14.1% +14.2% ➖ noise
9 datafusion:arrow +20.7% +11.7% +8.1% +14.2% ➖ noise
9 datafusion:vortex-compact +22.6% +11.7% +9.8% +14.2% ➖ noise
9 datafusion:vortex-file-compressed +20.9% +11.7% +8.3% +14.2% ➖ noise
9 duckdb:duckdb +19.1% +11.7% +6.7% +14.2% ➖ noise
9 duckdb:vortex-compact +31.6% +11.7% +17.9% +14.2% 🚨 regression
9 duckdb:vortex-file-compressed +39.9% +11.7% +25.3% +14.2% 🚨 regression
10 datafusion:arrow +18.5% +8.1% +9.6% +14.2% ➖ noise
10 datafusion:vortex-compact +16.2% +8.1% +7.5% +14.2% ➖ noise
10 datafusion:vortex-file-compressed +23.2% +8.1% +14.0% +14.2% ➖ noise
10 duckdb:duckdb +15.4% +8.1% +6.7% +14.2% ➖ noise
10 duckdb:vortex-compact -6.3% +8.1% -13.3% +14.2% ✅ faster
10 duckdb:vortex-file-compressed -4.5% +8.1% -11.6% +14.2% ➖ noise
11 datafusion:arrow +11.0% +9.9% +1.0% +14.2% ➖ noise
11 datafusion:vortex-compact +13.5% +9.9% +3.2% +14.2% ➖ noise
11 datafusion:vortex-file-compressed +18.6% +9.9% +7.9% +14.2% ➖ noise
11 duckdb:duckdb +20.5% +9.9% +9.6% +14.2% ➖ noise
11 duckdb:vortex-compact +0.2% +9.9% -8.8% +14.2% ➖ noise
11 duckdb:vortex-file-compressed +18.0% +9.9% +7.3% +14.2% ➖ noise
12 datafusion:arrow +25.6% +10.0% +14.1% +17.6% ➖ noise
12 datafusion:vortex-compact +12.7% +10.0% +2.5% +14.2% ➖ noise
12 datafusion:vortex-file-compressed +13.7% +10.0% +3.3% +14.2% ➖ noise
12 duckdb:duckdb +14.1% +10.0% +3.7% +14.2% ➖ noise
12 duckdb:vortex-compact +33.9% +10.0% +21.7% +14.2% 🚨 regression
12 duckdb:vortex-file-compressed +13.4% +10.0% +3.0% +14.2% ➖ noise
13 datafusion:arrow +15.7% +12.8% +2.6% +14.2% ➖ noise
13 datafusion:vortex-compact +15.0% +12.8% +1.9% +14.2% ➖ noise
13 datafusion:vortex-file-compressed +17.5% +12.8% +4.2% +14.2% ➖ noise
13 duckdb:duckdb +11.7% +12.8% -1.0% +14.2% ➖ noise
13 duckdb:vortex-compact +15.1% +12.8% +2.1% +14.2% ➖ noise
13 duckdb:vortex-file-compressed +14.7% +12.8% +1.7% +14.2% ➖ noise
14 datafusion:arrow +32.0% +10.5% +19.5% +14.2% 🚨 regression
14 datafusion:vortex-compact +12.9% +10.5% +2.2% +14.2% ➖ noise
14 datafusion:vortex-file-compressed +9.0% +10.5% -1.3% +14.2% ➖ noise
14 duckdb:duckdb +5.2% +10.5% -4.8% +15.1% ➖ noise
14 duckdb:vortex-compact +21.1% +10.5% +9.6% +14.2% ➖ noise
14 duckdb:vortex-file-compressed +19.0% +10.5% +7.7% +14.5% ➖ noise
15 datafusion:arrow +24.3% +10.1% +12.8% +14.2% ➖ noise
15 datafusion:vortex-compact +9.1% +10.1% -0.9% +14.2% ➖ noise
15 datafusion:vortex-file-compressed +7.3% +10.1% -2.6% +14.2% ➖ noise
15 duckdb:duckdb +3.6% +10.1% -6.0% +17.9% ➖ noise
15 duckdb:vortex-compact +18.1% +10.1% +7.3% +14.2% ➖ noise
15 duckdb:vortex-file-compressed +18.8% +10.1% +7.8% +14.2% ➖ noise
16 datafusion:arrow +11.7% +15.6% -3.4% +14.2% ➖ noise
16 datafusion:vortex-compact +14.5% +15.6% -0.9% +14.2% ➖ noise
16 datafusion:vortex-file-compressed +10.3% +15.6% -4.6% +14.2% ➖ noise
16 duckdb:duckdb +13.6% +15.6% -1.7% +14.2% ➖ noise
16 duckdb:vortex-compact +21.3% +15.6% +4.9% +14.2% ➖ noise
16 duckdb:vortex-file-compressed +14.1% +15.6% -1.3% +14.2% ➖ noise
17 datafusion:arrow +27.0% +10.4% +15.0% +14.2% 🚨 regression
17 datafusion:vortex-compact +24.6% +10.4% +12.9% +14.2% ➖ noise
17 datafusion:vortex-file-compressed +27.6% +10.4% +15.6% +14.2% 🚨 regression
17 duckdb:duckdb +15.7% +10.4% +4.8% +14.2% ➖ noise
17 duckdb:vortex-compact +8.7% +10.4% -1.5% +14.2% ➖ noise
17 duckdb:vortex-file-compressed +15.2% +10.4% +4.4% +14.2% ➖ noise
18 datafusion:arrow +26.4% +9.0% +16.0% +14.2% 🚨 regression
18 datafusion:vortex-compact +29.5% +9.0% +18.8% +14.2% 🚨 regression
18 datafusion:vortex-file-compressed +27.4% +9.0% +16.9% +14.2% 🚨 regression
18 duckdb:duckdb +10.2% +9.0% +1.1% +14.2% ➖ noise
18 duckdb:vortex-compact +7.8% +9.0% -1.1% +14.2% ➖ noise
18 duckdb:vortex-file-compressed +16.8% +9.0% +7.2% +14.2% ➖ noise
19 datafusion:arrow +50.5% +13.0% +33.1% +18.1% 🚨 regression
19 datafusion:vortex-compact +10.3% +13.0% -2.4% +14.2% ➖ noise
19 datafusion:vortex-file-compressed -2.7% +13.0% -13.9% +14.2% ✅ faster
19 duckdb:duckdb +16.6% +13.0% +3.2% +15.7% ➖ noise
19 duckdb:vortex-compact +24.0% +13.0% +9.7% +14.2% ➖ noise
19 duckdb:vortex-file-compressed +21.4% +13.0% +7.4% +14.2% ➖ noise
20 datafusion:arrow +31.0% +6.3% +23.3% +14.2% 🚨 regression
20 datafusion:vortex-compact +15.1% +6.3% +8.3% +14.2% ➖ noise
20 datafusion:vortex-file-compressed +19.1% +6.3% +12.1% +14.2% ➖ noise
20 duckdb:duckdb +8.5% +6.3% +2.1% +14.2% ➖ noise
20 duckdb:vortex-compact +1.9% +6.3% -4.1% +14.2% ➖ noise
20 duckdb:vortex-file-compressed +11.5% +6.3% +4.9% +14.2% ➖ noise
21 datafusion:arrow +21.8% +13.8% +7.0% +14.2% ➖ noise
21 datafusion:vortex-compact +24.6% +13.8% +9.6% +14.2% ➖ noise
21 datafusion:vortex-file-compressed +25.5% +13.8% +10.3% +14.2% ➖ noise
21 duckdb:duckdb +17.5% +13.8% +3.3% +14.2% ➖ noise
21 duckdb:vortex-compact +32.2% +13.8% +16.3% +14.2% 🚨 regression
21 duckdb:vortex-file-compressed +29.0% +13.8% +13.4% +14.2% ➖ noise
22 datafusion:arrow +16.8% +8.6% +7.5% +14.2% ➖ noise
22 datafusion:vortex-compact +12.5% +8.6% +3.6% +14.2% ➖ noise
22 datafusion:vortex-file-compressed +8.4% +8.6% -0.2% +14.2% ➖ noise
22 duckdb:duckdb +7.1% +8.6% -1.4% +14.2% ➖ noise
22 duckdb:vortex-compact +23.5% +8.6% +13.7% +14.2% ➖ noise
22 duckdb:vortex-file-compressed +26.9% +8.6% +16.9% +14.2% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Vortex (geomean): 0.988x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.6%

datafusion / vortex-file-compressed (0.985x ➖, 4↑ 1↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24520314 24686248 0.99
tpcds_q02/datafusion:vortex-file-compressed 46169366 46144563 1.00
tpcds_q03/datafusion:vortex-file-compressed 14993238 14707695 1.02
tpcds_q04/datafusion:vortex-file-compressed 253176808 247540471 1.02
tpcds_q05/datafusion:vortex-file-compressed 41479224 41622818 1.00
tpcds_q06/datafusion:vortex-file-compressed 60808512 60060831 1.01
tpcds_q07/datafusion:vortex-file-compressed 41143726 42360892 0.97
tpcds_q08/datafusion:vortex-file-compressed 28366128 28275998 1.00
tpcds_q09/datafusion:vortex-file-compressed 🚀 38438199 43874465 0.88
tpcds_q10/datafusion:vortex-file-compressed 39000338 38072997 1.02
tpcds_q11/datafusion:vortex-file-compressed 132041770 128506753 1.03
tpcds_q12/datafusion:vortex-file-compressed 20049343 19209129 1.04
tpcds_q13/datafusion:vortex-file-compressed 🚀 39150244 45757455 0.86
tpcds_q14/datafusion:vortex-file-compressed 166980543 169080133 0.99
tpcds_q15/datafusion:vortex-file-compressed 27876460 28252616 0.99
tpcds_q16/datafusion:vortex-file-compressed 28382813 29118654 0.97
tpcds_q17/datafusion:vortex-file-compressed 62509740 62567467 1.00
tpcds_q18/datafusion:vortex-file-compressed 67770406 68559216 0.99
tpcds_q19/datafusion:vortex-file-compressed 21569196 22548000 0.96
tpcds_q20/datafusion:vortex-file-compressed 21453621 22119993 0.97
tpcds_q21/datafusion:vortex-file-compressed 34859115 34594443 1.01
tpcds_q22/datafusion:vortex-file-compressed 🚀 108150105 151820687 0.71
tpcds_q23/datafusion:vortex-file-compressed 153678276 151154334 1.02
tpcds_q24/datafusion:vortex-file-compressed 81455489 84529731 0.96
tpcds_q25/datafusion:vortex-file-compressed 66805163 67248919 0.99
tpcds_q26/datafusion:vortex-file-compressed 34439074 33684032 1.02
tpcds_q27/datafusion:vortex-file-compressed 99177219 106802716 0.93
tpcds_q28/datafusion:vortex-file-compressed 🚀 34304741 40473375 0.85
tpcds_q29/datafusion:vortex-file-compressed 61682107 60254053 1.02
tpcds_q30/datafusion:vortex-file-compressed 22366407 22681860 0.99
tpcds_q31/datafusion:vortex-file-compressed 72173854 72089543 1.00
tpcds_q32/datafusion:vortex-file-compressed 20278764 20483970 0.99
tpcds_q33/datafusion:vortex-file-compressed 28948768 29201481 0.99
tpcds_q34/datafusion:vortex-file-compressed 23760318 24573198 0.97
tpcds_q35/datafusion:vortex-file-compressed 44132733 45620866 0.97
tpcds_q36/datafusion:vortex-file-compressed 57809695 57959542 1.00
tpcds_q37/datafusion:vortex-file-compressed 23838268 25505873 0.93
tpcds_q38/datafusion:vortex-file-compressed 45809483 43845783 1.04
tpcds_q39/datafusion:vortex-file-compressed 101187774 105527380 0.96
tpcds_q40/datafusion:vortex-file-compressed 32798763 33029575 0.99
tpcds_q41/datafusion:vortex-file-compressed 15025686 15445630 0.97
tpcds_q42/datafusion:vortex-file-compressed 14172002 14245607 0.99
tpcds_q43/datafusion:vortex-file-compressed 18476231 18849981 0.98
tpcds_q44/datafusion:vortex-file-compressed 32301592 31155817 1.04
tpcds_q45/datafusion:vortex-file-compressed 26399789 27732126 0.95
tpcds_q46/datafusion:vortex-file-compressed 33713225 35219245 0.96
tpcds_q47/datafusion:vortex-file-compressed 130981686 130513334 1.00
tpcds_q48/datafusion:vortex-file-compressed 35856596 39211348 0.91
tpcds_q49/datafusion:vortex-file-compressed 56847215 58086475 0.98
tpcds_q50/datafusion:vortex-file-compressed 39284409 39168465 1.00
tpcds_q51/datafusion:vortex-file-compressed 87311104 89781628 0.97
tpcds_q52/datafusion:vortex-file-compressed 13949902 14193646 0.98
tpcds_q53/datafusion:vortex-file-compressed 20728973 20436045 1.01
tpcds_q54/datafusion:vortex-file-compressed 35894654 34485806 1.04
tpcds_q55/datafusion:vortex-file-compressed 13440234 13880556 0.97
tpcds_q56/datafusion:vortex-file-compressed 29854864 29887230 1.00
tpcds_q57/datafusion:vortex-file-compressed 105409151 105728144 1.00
tpcds_q58/datafusion:vortex-file-compressed 50254022 53211220 0.94
tpcds_q59/datafusion:vortex-file-compressed 56226312 56279273 1.00
tpcds_q60/datafusion:vortex-file-compressed 29614174 28712912 1.03
tpcds_q61/datafusion:vortex-file-compressed 39788276 40008624 0.99
tpcds_q62/datafusion:vortex-file-compressed 🚨 24328583 21587205 1.13
tpcds_q63/datafusion:vortex-file-compressed 20971056 20869785 1.00
tpcds_q64/datafusion:vortex-file-compressed 400391439 403751219 0.99
tpcds_q65/datafusion:vortex-file-compressed 39037965 39813110 0.98
tpcds_q66/datafusion:vortex-file-compressed 68853724 73273477 0.94
tpcds_q67/datafusion:vortex-file-compressed 148443017 144549937 1.03
tpcds_q68/datafusion:vortex-file-compressed 31672962 31999211 0.99
tpcds_q69/datafusion:vortex-file-compressed 35246570 35691331 0.99
tpcds_q70/datafusion:vortex-file-compressed 82629591 84728553 0.98
tpcds_q71/datafusion:vortex-file-compressed 22667468 22324226 1.02
tpcds_q72/datafusion:vortex-file-compressed 2101466305 2116562847 0.99
tpcds_q73/datafusion:vortex-file-compressed 22019197 22970363 0.96
tpcds_q74/datafusion:vortex-file-compressed 77690269 79031847 0.98
tpcds_q75/datafusion:vortex-file-compressed 105460811 106494811 0.99
tpcds_q76/datafusion:vortex-file-compressed 23855061 24107108 0.99
tpcds_q77/datafusion:vortex-file-compressed 38772927 39829415 0.97
tpcds_q78/datafusion:vortex-file-compressed 121430389 123763204 0.98
tpcds_q79/datafusion:vortex-file-compressed 28513007 27951326 1.02
tpcds_q80/datafusion:vortex-file-compressed 94320242 93298252 1.01
tpcds_q81/datafusion:vortex-file-compressed 23520183 22941280 1.03
tpcds_q82/datafusion:vortex-file-compressed 24328035 26603480 0.91
tpcds_q83/datafusion:vortex-file-compressed 33133420 33397238 0.99
tpcds_q84/datafusion:vortex-file-compressed 12240389 12148299 1.01
tpcds_q85/datafusion:vortex-file-compressed 90834838 95421207 0.95
tpcds_q86/datafusion:vortex-file-compressed 16732026 15453249 1.08
tpcds_q87/datafusion:vortex-file-compressed 42341044 44013953 0.96
tpcds_q88/datafusion:vortex-file-compressed 55175433 54864689 1.01
tpcds_q89/datafusion:vortex-file-compressed 24658109 24600644 1.00
tpcds_q90/datafusion:vortex-file-compressed 14137059 14296297 0.99
tpcds_q91/datafusion:vortex-file-compressed 18310376 17696007 1.03
tpcds_q92/datafusion:vortex-file-compressed 17637186 17834265 0.99
tpcds_q93/datafusion:vortex-file-compressed 32897359 33920968 0.97
tpcds_q94/datafusion:vortex-file-compressed 22312102 24387236 0.91
tpcds_q95/datafusion:vortex-file-compressed 60137696 60620436 0.99
tpcds_q96/datafusion:vortex-file-compressed 13275871 13434553 0.99
tpcds_q97/datafusion:vortex-file-compressed 32722696 31575290 1.04
tpcds_q98/datafusion:vortex-file-compressed 23933993 23590070 1.01
tpcds_q99/datafusion:vortex-file-compressed 28161901 28197889 1.00
datafusion / vortex-compact (0.998x ➖, 5↑ 5↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 24437574 25430872 0.96
tpcds_q02/datafusion:vortex-compact 53335452 53202704 1.00
tpcds_q03/datafusion:vortex-compact 19465720 20335262 0.96
tpcds_q04/datafusion:vortex-compact 297562548 292226664 1.02
tpcds_q05/datafusion:vortex-compact 48197559 47549635 1.01
tpcds_q06/datafusion:vortex-compact 60970809 63693601 0.96
tpcds_q07/datafusion:vortex-compact 54996999 52058157 1.06
tpcds_q08/datafusion:vortex-compact 36123819 35964546 1.00
tpcds_q09/datafusion:vortex-compact 🚀 52381721 62107890 0.84
tpcds_q10/datafusion:vortex-compact 48401643 50324087 0.96
tpcds_q11/datafusion:vortex-compact 144432195 148302222 0.97
tpcds_q12/datafusion:vortex-compact 24728812 23055005 1.07
tpcds_q13/datafusion:vortex-compact 🚨 124557577 90391433 1.38
tpcds_q14/datafusion:vortex-compact 194241090 198254829 0.98
tpcds_q15/datafusion:vortex-compact 30223297 31148043 0.97
tpcds_q16/datafusion:vortex-compact 31330732 31984556 0.98
tpcds_q17/datafusion:vortex-compact 73197482 72647501 1.01
tpcds_q18/datafusion:vortex-compact 77627790 78494439 0.99
tpcds_q19/datafusion:vortex-compact 28714333 29047692 0.99
tpcds_q20/datafusion:vortex-compact 25264755 25619847 0.99
tpcds_q21/datafusion:vortex-compact 41337396 39881417 1.04
tpcds_q22/datafusion:vortex-compact 122981350 116303447 1.06
tpcds_q23/datafusion:vortex-compact 162487938 170890238 0.95
tpcds_q24/datafusion:vortex-compact 95946581 97057004 0.99
tpcds_q25/datafusion:vortex-compact 80869108 80847028 1.00
tpcds_q26/datafusion:vortex-compact 43368387 43620516 0.99
tpcds_q27/datafusion:vortex-compact 124054874 125329446 0.99
tpcds_q28/datafusion:vortex-compact 🚨 95657312 77299415 1.24
tpcds_q29/datafusion:vortex-compact 73046916 73146698 1.00
tpcds_q30/datafusion:vortex-compact 27277050 28762650 0.95
tpcds_q31/datafusion:vortex-compact 94248404 96049947 0.98
tpcds_q32/datafusion:vortex-compact 25070273 25714865 0.97
tpcds_q33/datafusion:vortex-compact 36800564 37577404 0.98
tpcds_q34/datafusion:vortex-compact 32894071 32461294 1.01
tpcds_q35/datafusion:vortex-compact 50463698 51984311 0.97
tpcds_q36/datafusion:vortex-compact 72545539 76021244 0.95
tpcds_q37/datafusion:vortex-compact 🚀 32832829 39967408 0.82
tpcds_q38/datafusion:vortex-compact 52831031 51821749 1.02
tpcds_q39/datafusion:vortex-compact 111780677 114458585 0.98
tpcds_q40/datafusion:vortex-compact 36253476 35869320 1.01
tpcds_q41/datafusion:vortex-compact 17501155 17612821 0.99
tpcds_q42/datafusion:vortex-compact 17922882 18114980 0.99
tpcds_q43/datafusion:vortex-compact 24381715 24663159 0.99
tpcds_q44/datafusion:vortex-compact 48092035 48363411 0.99
tpcds_q45/datafusion:vortex-compact 30204398 30406690 0.99
tpcds_q46/datafusion:vortex-compact 43994024 43723302 1.01
tpcds_q47/datafusion:vortex-compact 147759451 150742746 0.98
tpcds_q48/datafusion:vortex-compact 🚨 90588951 69478802 1.30
tpcds_q49/datafusion:vortex-compact 68862410 68730862 1.00
tpcds_q50/datafusion:vortex-compact 49666088 45806332 1.08
tpcds_q51/datafusion:vortex-compact 96821638 96955474 1.00
tpcds_q52/datafusion:vortex-compact 18384096 18201766 1.01
tpcds_q53/datafusion:vortex-compact 27943765 27571594 1.01
tpcds_q54/datafusion:vortex-compact 42799979 41578184 1.03
tpcds_q55/datafusion:vortex-compact 18214648 18153056 1.00
tpcds_q56/datafusion:vortex-compact 37189801 36473262 1.02
tpcds_q57/datafusion:vortex-compact 110557455 111117343 0.99
tpcds_q58/datafusion:vortex-compact 59483655 61848832 0.96
tpcds_q59/datafusion:vortex-compact 68861186 71351271 0.97
tpcds_q60/datafusion:vortex-compact 35374021 34712677 1.02
tpcds_q61/datafusion:vortex-compact 53702603 54805690 0.98
tpcds_q62/datafusion:vortex-compact 🚨 30827916 27434773 1.12
tpcds_q63/datafusion:vortex-compact 27349343 28031198 0.98
tpcds_q64/datafusion:vortex-compact 452942149 447771390 1.01
tpcds_q65/datafusion:vortex-compact 51786024 55086853 0.94
tpcds_q66/datafusion:vortex-compact 77067602 74626065 1.03
tpcds_q67/datafusion:vortex-compact 150070186 150406720 1.00
tpcds_q68/datafusion:vortex-compact 44229666 44475700 0.99
tpcds_q69/datafusion:vortex-compact 44656935 45014562 0.99
tpcds_q70/datafusion:vortex-compact 96152885 99514595 0.97
tpcds_q71/datafusion:vortex-compact 29803820 29248041 1.02
tpcds_q72/datafusion:vortex-compact 2139139937 2127689984 1.01
tpcds_q73/datafusion:vortex-compact 30096643 30132941 1.00
tpcds_q74/datafusion:vortex-compact 94196669 94606301 1.00
tpcds_q75/datafusion:vortex-compact 127000218 126008885 1.01
tpcds_q76/datafusion:vortex-compact 31728165 32137410 0.99
tpcds_q77/datafusion:vortex-compact 49665462 48782421 1.02
tpcds_q78/datafusion:vortex-compact 138203931 139566572 0.99
tpcds_q79/datafusion:vortex-compact 37716516 37568157 1.00
tpcds_q80/datafusion:vortex-compact 100871227 106923433 0.94
tpcds_q81/datafusion:vortex-compact 27769948 27778091 1.00
tpcds_q82/datafusion:vortex-compact 🚀 35387698 41065214 0.86
tpcds_q83/datafusion:vortex-compact 33038474 32882103 1.00
tpcds_q84/datafusion:vortex-compact 14408185 14304493 1.01
tpcds_q85/datafusion:vortex-compact 🚨 161358969 124400335 1.30
tpcds_q86/datafusion:vortex-compact 🚀 17935958 21688304 0.83
tpcds_q87/datafusion:vortex-compact 50990946 51376905 0.99
tpcds_q88/datafusion:vortex-compact 74813491 76463968 0.98
tpcds_q89/datafusion:vortex-compact 31722290 30976756 1.02
tpcds_q90/datafusion:vortex-compact 14854676 15231748 0.98
tpcds_q91/datafusion:vortex-compact 32124513 32280619 1.00
tpcds_q92/datafusion:vortex-compact 23731782 23916710 0.99
tpcds_q93/datafusion:vortex-compact 38391777 38126140 1.01
tpcds_q94/datafusion:vortex-compact 25984755 26841086 0.97
tpcds_q95/datafusion:vortex-compact 66817156 66460874 1.01
tpcds_q96/datafusion:vortex-compact 17384406 17287380 1.01
tpcds_q97/datafusion:vortex-compact 35803122 36932931 0.97
tpcds_q98/datafusion:vortex-compact 29712081 29349796 1.01
tpcds_q99/datafusion:vortex-compact 🚀 29743267 35354972 0.84
datafusion / parquet (1.005x ➖, 2↑ 2↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30590153 30262109 1.01
tpcds_q02/datafusion:parquet 40662893 41127812 0.99
tpcds_q03/datafusion:parquet 12988709 13548938 0.96
tpcds_q04/datafusion:parquet 256007788 272752630 0.94
tpcds_q05/datafusion:parquet 39500420 39887774 0.99
tpcds_q06/datafusion:parquet 62007528 57976011 1.07
tpcds_q07/datafusion:parquet 77823239 75112196 1.04
tpcds_q08/datafusion:parquet 25156595 25310310 0.99
tpcds_q09/datafusion:parquet 46030168 42966600 1.07
tpcds_q10/datafusion:parquet 67120849 67350663 1.00
tpcds_q11/datafusion:parquet 🚨 155473025 140552273 1.11
tpcds_q12/datafusion:parquet 17868357 17030152 1.05
tpcds_q13/datafusion:parquet 73830814 73381588 1.01
tpcds_q14/datafusion:parquet 157771004 157191927 1.00
tpcds_q15/datafusion:parquet 20005136 20909838 0.96
tpcds_q16/datafusion:parquet 22838757 23419422 0.98
tpcds_q17/datafusion:parquet 61681345 62525515 0.99
tpcds_q18/datafusion:parquet 🚀 111325170 126638967 0.88
tpcds_q19/datafusion:parquet 21929326 21865852 1.00
tpcds_q20/datafusion:parquet 15838006 15871015 1.00
tpcds_q21/datafusion:parquet 18893096 17966087 1.05
tpcds_q22/datafusion:parquet 170148987 161457285 1.05
tpcds_q23/datafusion:parquet 140400067 139277094 1.01
tpcds_q24/datafusion:parquet 87054757 88493019 0.98
tpcds_q25/datafusion:parquet 63206528 62927893 1.00
tpcds_q26/datafusion:parquet 64687112 63780971 1.01
tpcds_q27/datafusion:parquet 141080276 142170083 0.99
tpcds_q28/datafusion:parquet 43702163 43795599 1.00
tpcds_q29/datafusion:parquet 64732442 63720730 1.02
tpcds_q30/datafusion:parquet 33084344 33193429 1.00
tpcds_q31/datafusion:parquet 63136785 61529987 1.03
tpcds_q32/datafusion:parquet 18153948 18394292 0.99
tpcds_q33/datafusion:parquet 25991409 27470947 0.95
tpcds_q34/datafusion:parquet 20076323 22272925 0.90
tpcds_q35/datafusion:parquet 68992646 66531685 1.04
tpcds_q36/datafusion:parquet 56528531 54479674 1.04
tpcds_q37/datafusion:parquet 18587369 18056736 1.03
tpcds_q38/datafusion:parquet 39605258 38516946 1.03
tpcds_q39/datafusion:parquet 73785685 72494615 1.02
tpcds_q40/datafusion:parquet 24255406 23343332 1.04
tpcds_q41/datafusion:parquet 12959979 13178495 0.98
tpcds_q42/datafusion:parquet 11435618 11276949 1.01
tpcds_q43/datafusion:parquet 16354135 16472795 0.99
tpcds_q44/datafusion:parquet 32289498 31548705 1.02
tpcds_q45/datafusion:parquet 27779024 27045449 1.03
tpcds_q46/datafusion:parquet 31891814 31121280 1.02
tpcds_q47/datafusion:parquet 122975620 121800139 1.01
tpcds_q48/datafusion:parquet 67337541 68570530 0.98
tpcds_q49/datafusion:parquet 54764449 54342777 1.01
tpcds_q50/datafusion:parquet 42469257 43531155 0.98
tpcds_q51/datafusion:parquet 82183456 87067114 0.94
tpcds_q52/datafusion:parquet 11339283 11343921 1.00
tpcds_q53/datafusion:parquet 17392941 17128464 1.02
tpcds_q54/datafusion:parquet 33101412 32726030 1.01
tpcds_q55/datafusion:parquet 10672107 10771265 0.99
tpcds_q56/datafusion:parquet 26551120 26278820 1.01
tpcds_q57/datafusion:parquet 96300055 93708135 1.03
tpcds_q58/datafusion:parquet 49046670 50019030 0.98
tpcds_q59/datafusion:parquet 56153353 55240094 1.02
tpcds_q60/datafusion:parquet 27553194 26396774 1.04
tpcds_q61/datafusion:parquet 41534771 42972397 0.97
tpcds_q62/datafusion:parquet 🚨 25404947 20313987 1.25
tpcds_q63/datafusion:parquet 17583089 17329044 1.01
tpcds_q64/datafusion:parquet 499531024 502431723 0.99
tpcds_q65/datafusion:parquet 36994883 37138053 1.00
tpcds_q66/datafusion:parquet 66691859 65351879 1.02
tpcds_q67/datafusion:parquet 144952845 145820265 0.99
tpcds_q68/datafusion:parquet 31101094 31240360 1.00
tpcds_q69/datafusion:parquet 62950258 63687751 0.99
tpcds_q70/datafusion:parquet 87472377 82850449 1.06
tpcds_q71/datafusion:parquet 20938414 21197836 0.99
tpcds_q72/datafusion:parquet 586681955 587436116 1.00
tpcds_q73/datafusion:parquet 20389041 21158020 0.96
tpcds_q74/datafusion:parquet 81561400 79348580 1.03
tpcds_q75/datafusion:parquet 98875111 95039471 1.04
tpcds_q76/datafusion:parquet 29584790 28996441 1.02
tpcds_q77/datafusion:parquet 38219860 37082170 1.03
tpcds_q78/datafusion:parquet 114341892 113465376 1.01
tpcds_q79/datafusion:parquet 25585835 25076456 1.02
tpcds_q80/datafusion:parquet 77489902 77529032 1.00
tpcds_q81/datafusion:parquet 31604328 30743874 1.03
tpcds_q82/datafusion:parquet 18808274 18643820 1.01
tpcds_q83/datafusion:parquet 35580225 35616057 1.00
tpcds_q84/datafusion:parquet 38014987 37687660 1.01
tpcds_q85/datafusion:parquet 146689917 143363482 1.02
tpcds_q86/datafusion:parquet 🚀 13583946 15717184 0.86
tpcds_q87/datafusion:parquet 39400273 40021423 0.98
tpcds_q88/datafusion:parquet 57507343 57898269 0.99
tpcds_q89/datafusion:parquet 20641783 20442477 1.01
tpcds_q90/datafusion:parquet 13215801 13550371 0.98
tpcds_q91/datafusion:parquet 55803311 56204766 0.99
tpcds_q92/datafusion:parquet 17874971 17534299 1.02
tpcds_q93/datafusion:parquet 30574171 30093674 1.02
tpcds_q94/datafusion:parquet 19939637 19641386 1.02
tpcds_q95/datafusion:parquet 59694661 57739069 1.03
tpcds_q96/datafusion:parquet 11685762 11198561 1.04
tpcds_q97/datafusion:parquet 28418162 29356467 0.97
tpcds_q98/datafusion:parquet 21160111 20821901 1.02
tpcds_q99/datafusion:parquet 27247429 29853197 0.91
duckdb / vortex-file-compressed (1.003x ➖, 11↑ 14↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 20244950 21320624 0.95
tpcds_q02/duckdb:vortex-file-compressed 34142333 36715675 0.93
tpcds_q03/duckdb:vortex-file-compressed 🚀 25839815 32392345 0.80
tpcds_q04/duckdb:vortex-file-compressed 99805858 90836516 1.10
tpcds_q05/duckdb:vortex-file-compressed 33915520 36589532 0.93
tpcds_q06/duckdb:vortex-file-compressed 30977320 30990496 1.00
tpcds_q07/duckdb:vortex-file-compressed 19264303 19059782 1.01
tpcds_q08/duckdb:vortex-file-compressed 26910944 27635371 0.97
tpcds_q09/duckdb:vortex-file-compressed 🚨 32944547 16930651 1.95
tpcds_q10/duckdb:vortex-file-compressed 35478166 37530386 0.95
tpcds_q11/duckdb:vortex-file-compressed 59973614 60701373 0.99
tpcds_q12/duckdb:vortex-file-compressed 12865344 13363152 0.96
tpcds_q13/duckdb:vortex-file-compressed 30911597 33744543 0.92
tpcds_q14/duckdb:vortex-file-compressed 98721606 99938243 0.99
tpcds_q15/duckdb:vortex-file-compressed 25071972 26950020 0.93
tpcds_q16/duckdb:vortex-file-compressed 23933465 25212973 0.95
tpcds_q17/duckdb:vortex-file-compressed 43218615 44998158 0.96
tpcds_q18/duckdb:vortex-file-compressed 🚨 45924148 35764428 1.28
tpcds_q19/duckdb:vortex-file-compressed 30905177 32186213 0.96
tpcds_q20/duckdb:vortex-file-compressed 14304909 13723026 1.04
tpcds_q21/duckdb:vortex-file-compressed 15856894 15512954 1.02
tpcds_q22/duckdb:vortex-file-compressed 75861987 71258968 1.06
tpcds_q23/duckdb:vortex-file-compressed 102788541 107263350 0.96
tpcds_q24/duckdb:vortex-file-compressed 47155069 46695794 1.01
tpcds_q25/duckdb:vortex-file-compressed 48129871 48380521 0.99
tpcds_q26/duckdb:vortex-file-compressed 🚨 37730170 18014421 2.09
tpcds_q27/duckdb:vortex-file-compressed 🚨 44463552 20871467 2.13
tpcds_q28/duckdb:vortex-file-compressed 🚨 28723442 14887309 1.93
tpcds_q29/duckdb:vortex-file-compressed 41287675 40502908 1.02
tpcds_q30/duckdb:vortex-file-compressed 22809617 23889122 0.95
tpcds_q31/duckdb:vortex-file-compressed 🚨 32840277 25781716 1.27
tpcds_q32/duckdb:vortex-file-compressed 13690783 13535529 1.01
tpcds_q33/duckdb:vortex-file-compressed 22322409 23183077 0.96
tpcds_q34/duckdb:vortex-file-compressed 21414494 23139264 0.93
tpcds_q35/duckdb:vortex-file-compressed 60634469 62558823 0.97
tpcds_q36/duckdb:vortex-file-compressed 22218474 23699700 0.94
tpcds_q37/duckdb:vortex-file-compressed 🚀 14438799 18966476 0.76
tpcds_q38/duckdb:vortex-file-compressed 36339851 34826501 1.04
tpcds_q39/duckdb:vortex-file-compressed 34233381 32776422 1.04
tpcds_q40/duckdb:vortex-file-compressed 18877576 19218983 0.98
tpcds_q41/duckdb:vortex-file-compressed 🚨 12337502 9590917 1.29
tpcds_q42/duckdb:vortex-file-compressed 11661194 12376128 0.94
tpcds_q43/duckdb:vortex-file-compressed 21485907 22685813 0.95
tpcds_q44/duckdb:vortex-file-compressed 20840975 21473506 0.97
tpcds_q45/duckdb:vortex-file-compressed 27934984 27460082 1.02
tpcds_q46/duckdb:vortex-file-compressed 🚨 49411757 32075576 1.54
tpcds_q47/duckdb:vortex-file-compressed 46341618 47702166 0.97
tpcds_q48/duckdb:vortex-file-compressed 27787796 29998334 0.93
tpcds_q49/duckdb:vortex-file-compressed 32710550 30657435 1.07
tpcds_q50/duckdb:vortex-file-compressed 32701151 32569645 1.00
tpcds_q51/duckdb:vortex-file-compressed 🚨 116040314 98506827 1.18
tpcds_q52/duckdb:vortex-file-compressed 🚀 10701994 11987335 0.89
tpcds_q53/duckdb:vortex-file-compressed 22352453 23088902 0.97
tpcds_q54/duckdb:vortex-file-compressed 26971119 26531067 1.02
tpcds_q55/duckdb:vortex-file-compressed 11632414 12734150 0.91
tpcds_q56/duckdb:vortex-file-compressed 🚀 21764215 25203546 0.86
tpcds_q57/duckdb:vortex-file-compressed 38791475 38247944 1.01
tpcds_q58/duckdb:vortex-file-compressed 27993309 30043880 0.93
tpcds_q59/duckdb:vortex-file-compressed 66288337 66555794 1.00
tpcds_q60/duckdb:vortex-file-compressed 🚀 22375677 25188186 0.89
tpcds_q61/duckdb:vortex-file-compressed 30273247 31032702 0.98
tpcds_q62/duckdb:vortex-file-compressed 16410599 16511176 0.99
tpcds_q63/duckdb:vortex-file-compressed 19486541 21107134 0.92
tpcds_q64/duckdb:vortex-file-compressed 🚀 77180661 105122149 0.73
tpcds_q65/duckdb:vortex-file-compressed 21548294 20621964 1.04
tpcds_q66/duckdb:vortex-file-compressed 27809861 28575983 0.97
tpcds_q67/duckdb:vortex-file-compressed 134301926 134582335 1.00
tpcds_q68/duckdb:vortex-file-compressed 38250621 35215460 1.09
tpcds_q69/duckdb:vortex-file-compressed 37470370 40838275 0.92
tpcds_q70/duckdb:vortex-file-compressed 🚀 25811968 39844152 0.65
tpcds_q71/duckdb:vortex-file-compressed 19533779 19989345 0.98
tpcds_q72/duckdb:vortex-file-compressed 171738669 167190475 1.03
tpcds_q73/duckdb:vortex-file-compressed 21759091 24139615 0.90
tpcds_q74/duckdb:vortex-file-compressed 🚨 69770166 39612698 1.76
tpcds_q75/duckdb:vortex-file-compressed 🚨 56836645 47297507 1.20
tpcds_q76/duckdb:vortex-file-compressed 16810166 16575459 1.01
tpcds_q77/duckdb:vortex-file-compressed 21452558 23387384 0.92
tpcds_q78/duckdb:vortex-file-compressed 73976578 74230645 1.00
tpcds_q79/duckdb:vortex-file-compressed 🚨 31384083 26336323 1.19
tpcds_q80/duckdb:vortex-file-compressed 40920933 44339758 0.92
tpcds_q81/duckdb:vortex-file-compressed 26090358 28189539 0.93
tpcds_q82/duckdb:vortex-file-compressed 🚀 15696752 49463726 0.32
tpcds_q83/duckdb:vortex-file-compressed 🚀 23210314 26467013 0.88
tpcds_q84/duckdb:vortex-file-compressed 18762651 18257638 1.03
tpcds_q85/duckdb:vortex-file-compressed 43292192 42749065 1.01
tpcds_q86/duckdb:vortex-file-compressed 15689442 16223802 0.97
tpcds_q87/duckdb:vortex-file-compressed 39945044 37559029 1.06
tpcds_q88/duckdb:vortex-file-compressed 🚀 32204222 58050591 0.55
tpcds_q89/duckdb:vortex-file-compressed 20539376 22073966 0.93
tpcds_q90/duckdb:vortex-file-compressed 🚨 11741973 9721720 1.21
tpcds_q91/duckdb:vortex-file-compressed 🚨 29109891 24197928 1.20
tpcds_q92/duckdb:vortex-file-compressed 🚀 18459470 20723009 0.89
tpcds_q93/duckdb:vortex-file-compressed 28550140 26796454 1.07
tpcds_q94/duckdb:vortex-file-compressed 21012173 22135349 0.95
tpcds_q95/duckdb:vortex-file-compressed 145025181 141318612 1.03
tpcds_q96/duckdb:vortex-file-compressed 11865764 12698033 0.93
tpcds_q97/duckdb:vortex-file-compressed 37889639 36271978 1.04
tpcds_q98/duckdb:vortex-file-compressed 16284331 18023512 0.90
tpcds_q99/duckdb:vortex-file-compressed 25606067 26977981 0.95
duckdb / vortex-compact (0.965x ➖, 36↑ 11↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23261173 23021158 1.01
tpcds_q02/duckdb:vortex-compact 41169835 39899032 1.03
tpcds_q03/duckdb:vortex-compact 🚀 48816127 57588298 0.85
tpcds_q04/duckdb:vortex-compact 🚨 117767608 101113456 1.16
tpcds_q05/duckdb:vortex-compact 🚀 41170357 46695300 0.88
tpcds_q06/duckdb:vortex-compact 38021534 40016888 0.95
tpcds_q07/duckdb:vortex-compact 33293011 34333642 0.97
tpcds_q08/duckdb:vortex-compact 🚀 38522264 44469736 0.87
tpcds_q09/duckdb:vortex-compact 🚨 48793994 18897968 2.58
tpcds_q10/duckdb:vortex-compact 51494206 57063227 0.90
tpcds_q11/duckdb:vortex-compact 🚀 65848327 73507785 0.90
tpcds_q12/duckdb:vortex-compact 20322916 21906177 0.93
tpcds_q13/duckdb:vortex-compact 51710989 56346981 0.92
tpcds_q14/duckdb:vortex-compact 120089995 123725007 0.97
tpcds_q15/duckdb:vortex-compact 30270918 29223133 1.04
tpcds_q16/duckdb:vortex-compact 27247397 28306968 0.96
tpcds_q17/duckdb:vortex-compact 52855404 56224171 0.94
tpcds_q18/duckdb:vortex-compact 🚨 56152188 45597594 1.23
tpcds_q19/duckdb:vortex-compact 🚀 43275963 50363387 0.86
tpcds_q20/duckdb:vortex-compact 18245273 18563858 0.98
tpcds_q21/duckdb:vortex-compact 17675818 17696997 1.00
tpcds_q22/duckdb:vortex-compact 73643605 73948874 1.00
tpcds_q23/duckdb:vortex-compact 🚀 112381773 138485102 0.81
tpcds_q24/duckdb:vortex-compact 🚀 56207669 63068325 0.89
tpcds_q25/duckdb:vortex-compact 77603102 79284358 0.98
tpcds_q26/duckdb:vortex-compact 🚨 49265012 30695588 1.60
tpcds_q27/duckdb:vortex-compact 🚨 64482766 35620238 1.81
tpcds_q28/duckdb:vortex-compact 🚨 100185819 26780827 3.74
tpcds_q29/duckdb:vortex-compact 53149898 53325637 1.00
tpcds_q30/duckdb:vortex-compact 27652861 29489936 0.94
tpcds_q31/duckdb:vortex-compact 39696896 37152237 1.07
tpcds_q32/duckdb:vortex-compact 🚀 19772412 22238179 0.89
tpcds_q33/duckdb:vortex-compact 🚀 31083994 34839457 0.89
tpcds_q34/duckdb:vortex-compact 33331302 35662129 0.93
tpcds_q35/duckdb:vortex-compact 73983919 79748715 0.93
tpcds_q36/duckdb:vortex-compact 35615657 38834356 0.92
tpcds_q37/duckdb:vortex-compact 22019670 23192775 0.95
tpcds_q38/duckdb:vortex-compact 40780458 42114150 0.97
tpcds_q39/duckdb:vortex-compact 36728721 35858895 1.02
tpcds_q40/duckdb:vortex-compact 23332495 24171555 0.97
tpcds_q41/duckdb:vortex-compact 🚨 15351240 10861869 1.41
tpcds_q42/duckdb:vortex-compact 🚀 18559565 21383066 0.87
tpcds_q43/duckdb:vortex-compact 🚀 31630738 37878783 0.84
tpcds_q44/duckdb:vortex-compact 29854093 28705240 1.04
tpcds_q45/duckdb:vortex-compact 34974323 36989213 0.95
tpcds_q46/duckdb:vortex-compact 🚨 64497330 52619333 1.23
tpcds_q47/duckdb:vortex-compact 🚀 54284593 63047501 0.86
tpcds_q48/duckdb:vortex-compact 🚀 44523184 52822055 0.84
tpcds_q49/duckdb:vortex-compact 48166710 48175528 1.00
tpcds_q50/duckdb:vortex-compact 🚀 39056071 44497100 0.88
tpcds_q51/duckdb:vortex-compact 102572238 106109453 0.97
tpcds_q52/duckdb:vortex-compact 🚀 18505449 21437086 0.86
tpcds_q53/duckdb:vortex-compact 🚀 31336706 37759737 0.83
tpcds_q54/duckdb:vortex-compact 🚀 34993382 40213012 0.87
tpcds_q55/duckdb:vortex-compact 19749221 21565167 0.92
tpcds_q56/duckdb:vortex-compact 🚀 30932082 34815887 0.89
tpcds_q57/duckdb:vortex-compact 41570018 42683283 0.97
tpcds_q58/duckdb:vortex-compact 37477170 40348381 0.93
tpcds_q59/duckdb:vortex-compact 84969999 84537768 1.01
tpcds_q60/duckdb:vortex-compact 🚀 32557039 37572101 0.87
tpcds_q61/duckdb:vortex-compact 🚀 49427857 63202999 0.78
tpcds_q62/duckdb:vortex-compact 🚀 20792037 25497988 0.82
tpcds_q63/duckdb:vortex-compact 🚀 31083916 37306192 0.83
tpcds_q64/duckdb:vortex-compact 🚀 107909423 143371895 0.75
tpcds_q65/duckdb:vortex-compact 29703954 31014693 0.96
tpcds_q66/duckdb:vortex-compact 37595707 37781301 1.00
tpcds_q67/duckdb:vortex-compact 150490500 151554161 0.99
tpcds_q68/duckdb:vortex-compact 56062268 54061023 1.04
tpcds_q69/duckdb:vortex-compact 🚀 53779151 60365754 0.89
tpcds_q70/duckdb:vortex-compact 🚀 32873345 69940713 0.47
tpcds_q71/duckdb:vortex-compact 🚀 28869429 32942845 0.88
tpcds_q72/duckdb:vortex-compact 🚨 198770880 179139467 1.11
tpcds_q73/duckdb:vortex-compact 30655432 32672634 0.94
tpcds_q74/duckdb:vortex-compact 🚨 77759072 49853784 1.56
tpcds_q75/duckdb:vortex-compact 66306556 63112367 1.05
tpcds_q76/duckdb:vortex-compact 29823020 30880767 0.97
tpcds_q77/duckdb:vortex-compact 🚀 36869960 42843177 0.86
tpcds_q78/duckdb:vortex-compact 81617415 87649235 0.93
tpcds_q79/duckdb:vortex-compact 45592729 45014567 1.01
tpcds_q80/duckdb:vortex-compact 🚀 68083097 78393121 0.87
tpcds_q81/duckdb:vortex-compact 32650793 33145840 0.99
tpcds_q82/duckdb:vortex-compact 🚀 23260175 50920674 0.46
tpcds_q83/duckdb:vortex-compact 🚀 30689914 35510360 0.86
tpcds_q84/duckdb:vortex-compact 26088016 26370842 0.99
tpcds_q85/duckdb:vortex-compact 54876946 54684884 1.00
tpcds_q86/duckdb:vortex-compact 🚀 19788551 22167431 0.89
tpcds_q87/duckdb:vortex-compact 43118970 44107232 0.98
tpcds_q88/duckdb:vortex-compact 🚀 37801193 84904924 0.45
tpcds_q89/duckdb:vortex-compact 🚀 30868831 35985492 0.86
tpcds_q90/duckdb:vortex-compact 🚨 14980368 11293435 1.33
tpcds_q91/duckdb:vortex-compact 47631942 46919331 1.02
tpcds_q92/duckdb:vortex-compact 48507124 48145076 1.01
tpcds_q93/duckdb:vortex-compact 31910312 31635452 1.01
tpcds_q94/duckdb:vortex-compact 🚀 26364886 30523489 0.86
tpcds_q95/duckdb:vortex-compact 157029223 146060747 1.08
tpcds_q96/duckdb:vortex-compact 15589003 16670616 0.94
tpcds_q97/duckdb:vortex-compact 🚀 38147232 44655576 0.85
tpcds_q98/duckdb:vortex-compact 🚀 24902868 27744239 0.90
tpcds_q99/duckdb:vortex-compact 29321028 32226595 0.91
duckdb / parquet (1.000x ➖, 1↑ 3↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 27125346 27589727 0.98
tpcds_q02/duckdb:parquet 23394586 24995970 0.94
tpcds_q03/duckdb:parquet 11100241 11266641 0.99
tpcds_q04/duckdb:parquet 168558497 169876976 0.99
tpcds_q05/duckdb:parquet 🚨 31739641 28196487 1.13
tpcds_q06/duckdb:parquet 27193303 26986905 1.01
tpcds_q07/duckdb:parquet 21115317 20617633 1.02
tpcds_q08/duckdb:parquet 26399487 26752226 0.99
tpcds_q09/duckdb:parquet 38932214 39319304 0.99
tpcds_q10/duckdb:parquet 31994042 33292910 0.96
tpcds_q11/duckdb:parquet 85198238 82579318 1.03
tpcds_q12/duckdb:parquet 14198829 14361108 0.99
tpcds_q13/duckdb:parquet 32082173 32602326 0.98
tpcds_q14/duckdb:parquet 97445357 98147412 0.99
tpcds_q15/duckdb:parquet 28963901 30188184 0.96
tpcds_q16/duckdb:parquet 20287704 20621871 0.98
tpcds_q17/duckdb:parquet 35297250 38331748 0.92
tpcds_q18/duckdb:parquet 45157209 45181994 1.00
tpcds_q19/duckdb:parquet 28209770 29160766 0.97
tpcds_q20/duckdb:parquet 14983533 14959372 1.00
tpcds_q21/duckdb:parquet 9807329 9723078 1.01
tpcds_q22/duckdb:parquet 66447088 69206872 0.96
tpcds_q23/duckdb:parquet 79221908 82081923 0.97
tpcds_q24/duckdb:parquet 46876260 44087678 1.06
tpcds_q25/duckdb:parquet 32458946 32154566 1.01
tpcds_q26/duckdb:parquet 35422214 34899387 1.01
tpcds_q27/duckdb:parquet 46179073 47626003 0.97
tpcds_q28/duckdb:parquet 37148720 37679478 0.99
tpcds_q29/duckdb:parquet 34382077 34272005 1.00
tpcds_q30/duckdb:parquet 34269718 34188764 1.00
tpcds_q31/duckdb:parquet 23811009 22515526 1.06
tpcds_q32/duckdb:parquet 10739354 10775197 1.00
tpcds_q33/duckdb:parquet 20423938 20460412 1.00
tpcds_q34/duckdb:parquet 19913445 20139362 0.99
tpcds_q35/duckdb:parquet 57212433 58097274 0.98
tpcds_q36/duckdb:parquet 19641616 19493144 1.01
tpcds_q37/duckdb:parquet 🚨 12937366 11659151 1.11
tpcds_q38/duckdb:parquet 32776014 33525759 0.98
tpcds_q39/duckdb:parquet 🚀 28711904 34629113 0.83
tpcds_q40/duckdb:parquet 17272487 16226537 1.06
tpcds_q41/duckdb:parquet 7401307 7490860 0.99
tpcds_q42/duckdb:parquet 9207025 9369669 0.98
tpcds_q43/duckdb:parquet 14721382 15055784 0.98
tpcds_q44/duckdb:parquet 22050774 22822204 0.97
tpcds_q45/duckdb:parquet 27134824 26480132 1.02
tpcds_q46/duckdb:parquet 44842352 43832335 1.02
tpcds_q47/duckdb:parquet 44071412 44366560 0.99
tpcds_q48/duckdb:parquet 28791306 28731910 1.00
tpcds_q49/duckdb:parquet 23635598 25171301 0.94
tpcds_q50/duckdb:parquet 24108665 23941477 1.01
tpcds_q51/duckdb:parquet 92766833 91868148 1.01
tpcds_q52/duckdb:parquet 10124792 10151570 1.00
tpcds_q53/duckdb:parquet 14666773 14973743 0.98
tpcds_q54/duckdb:parquet 25730116 24129543 1.07
tpcds_q55/duckdb:parquet 9541372 9746510 0.98
tpcds_q56/duckdb:parquet 20086206 20203523 0.99
tpcds_q57/duckdb:parquet 31935056 34112187 0.94
tpcds_q58/duckdb:parquet 22098007 22146893 1.00
tpcds_q59/duckdb:parquet 35061659 35395587 0.99
tpcds_q60/duckdb:parquet 21740430 20640183 1.05
tpcds_q61/duckdb:parquet 30124629 31140365 0.97
tpcds_q62/duckdb:parquet 11424170 11444611 1.00
tpcds_q63/duckdb:parquet 13874885 13645090 1.02
tpcds_q64/duckdb:parquet 73035572 70740766 1.03
tpcds_q65/duckdb:parquet 19475003 19135050 1.02
tpcds_q66/duckdb:parquet 28561659 27638651 1.03
tpcds_q67/duckdb:parquet 134885769 135612916 0.99
tpcds_q68/duckdb:parquet 35884294 36392565 0.99
tpcds_q69/duckdb:parquet 35529325 34892728 1.02
tpcds_q70/duckdb:parquet 18916784 18814725 1.01
tpcds_q71/duckdb:parquet 18723751 18936442 0.99
tpcds_q72/duckdb:parquet 164445748 163921571 1.00
tpcds_q73/duckdb:parquet 17935500 17685059 1.01
tpcds_q74/duckdb:parquet 124855133 125898020 0.99
tpcds_q75/duckdb:parquet 51825421 51471022 1.01
tpcds_q76/duckdb:parquet 19548546 18845375 1.04
tpcds_q77/duckdb:parquet 21902185 20834585 1.05
tpcds_q78/duckdb:parquet 74185461 76617845 0.97
tpcds_q79/duckdb:parquet 27108950 26176887 1.04
tpcds_q80/duckdb:parquet 39922648 40740061 0.98
tpcds_q81/duckdb:parquet 30226990 30260408 1.00
tpcds_q82/duckdb:parquet 13561989 13057905 1.04
tpcds_q83/duckdb:parquet 16178441 16345458 0.99
tpcds_q84/duckdb:parquet 19218419 19159477 1.00
tpcds_q85/duckdb:parquet 37802113 37816679 1.00
tpcds_q86/duckdb:parquet 12626427 11887849 1.06
tpcds_q87/duckdb:parquet 36408076 36356260 1.00
tpcds_q88/duckdb:parquet 49056016 48268278 1.02
tpcds_q89/duckdb:parquet 15617071 16271786 0.96
tpcds_q90/duckdb:parquet 7170732 7182226 1.00
tpcds_q91/duckdb:parquet 22862084 22592573 1.01
tpcds_q92/duckdb:parquet 10933639 11310032 0.97
tpcds_q93/duckdb:parquet 29244671 27326041 1.07
tpcds_q94/duckdb:parquet 15509597 16166467 0.96
tpcds_q95/duckdb:parquet 🚨 143961097 121974783 1.18
tpcds_q96/duckdb:parquet 8289869 8588144 0.97
tpcds_q97/duckdb:parquet 33754278 34421527 0.98
tpcds_q98/duckdb:parquet 17630966 17225848 1.02
tpcds_q99/duckdb:parquet 19310835 19675214 0.98
duckdb / duckdb (1.034x ➖, 1↑ 8↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20978977 20413795 1.03
tpcds_q02/duckdb:duckdb 19356327 19001196 1.02
tpcds_q03/duckdb:duckdb 9047925 8447326 1.07
tpcds_q04/duckdb:duckdb 178126596 165728803 1.07
tpcds_q05/duckdb:duckdb 19564503 18678489 1.05
tpcds_q06/duckdb:duckdb 23277570 22912904 1.02
tpcds_q07/duckdb:duckdb 38353008 37355525 1.03
tpcds_q08/duckdb:duckdb 121499925 119463400 1.02
tpcds_q09/duckdb:duckdb 20032074 19616161 1.02
tpcds_q10/duckdb:duckdb 🚨 25478101 22733763 1.12
tpcds_q11/duckdb:duckdb 95781282 90197916 1.06
tpcds_q12/duckdb:duckdb 11447032 11296574 1.01
tpcds_q13/duckdb:duckdb 25419738 23869698 1.06
tpcds_q14/duckdb:duckdb 94033935 91384115 1.03
tpcds_q15/duckdb:duckdb 24247091 23893013 1.01
tpcds_q16/duckdb:duckdb 18645023 18607249 1.00
tpcds_q17/duckdb:duckdb 22618060 21203035 1.07
tpcds_q18/duckdb:duckdb 44967133 44173827 1.02
tpcds_q19/duckdb:duckdb 16455363 16302519 1.01
tpcds_q20/duckdb:duckdb 12397610 11872992 1.04
tpcds_q21/duckdb:duckdb 7226134 6903697 1.05
tpcds_q22/duckdb:duckdb 63545711 60756006 1.05
tpcds_q23/duckdb:duckdb 75361802 77969950 0.97
tpcds_q24/duckdb:duckdb 🚨 26681586 23812689 1.12
tpcds_q25/duckdb:duckdb 17812600 16556311 1.08
tpcds_q26/duckdb:duckdb 26395623 26001940 1.02
tpcds_q27/duckdb:duckdb 37529344 38740655 0.97
tpcds_q28/duckdb:duckdb 22242073 21850872 1.02
tpcds_q29/duckdb:duckdb 20207872 20384762 0.99
tpcds_q30/duckdb:duckdb 30898517 29976837 1.03
tpcds_q31/duckdb:duckdb 49168825 46942583 1.05
tpcds_q32/duckdb:duckdb 7072029 6974168 1.01
tpcds_q33/duckdb:duckdb 12425996 12484674 1.00
tpcds_q34/duckdb:duckdb 16214284 15317072 1.06
tpcds_q35/duckdb:duckdb 33330921 32339377 1.03
tpcds_q36/duckdb:duckdb 70192152 68988167 1.02
tpcds_q37/duckdb:duckdb 7568244 7913063 0.96
tpcds_q38/duckdb:duckdb 🚨 34600120 29541174 1.17
tpcds_q39/duckdb:duckdb 25270175 23746189 1.06
tpcds_q40/duckdb:duckdb 13035694 13542587 0.96
tpcds_q41/duckdb:duckdb 8064396 8315756 0.97
tpcds_q42/duckdb:duckdb 6417988 6274874 1.02
tpcds_q43/duckdb:duckdb 11277483 11259512 1.00
tpcds_q44/duckdb:duckdb 13693211 14121096 0.97
tpcds_q45/duckdb:duckdb 17242733 17143731 1.01
tpcds_q46/duckdb:duckdb 36813753 35895841 1.03
tpcds_q47/duckdb:duckdb 40769608 40077881 1.02
tpcds_q48/duckdb:duckdb 23284520 21806761 1.07
tpcds_q49/duckdb:duckdb 16973981 17416786 0.97
tpcds_q50/duckdb:duckdb 14647977 14175712 1.03
tpcds_q51/duckdb:duckdb 90099437 86602888 1.04
tpcds_q52/duckdb:duckdb 7495974 7255393 1.03
tpcds_q53/duckdb:duckdb 13677504 13188654 1.04
tpcds_q54/duckdb:duckdb 16516426 16723629 0.99
tpcds_q55/duckdb:duckdb 7064689 6937777 1.02
tpcds_q56/duckdb:duckdb 13546876 13695730 0.99
tpcds_q57/duckdb:duckdb 32194883 31820346 1.01
tpcds_q58/duckdb:duckdb 13799243 12775127 1.08
tpcds_q59/duckdb:duckdb 36935565 35259304 1.05
tpcds_q60/duckdb:duckdb 🚨 15784999 14112731 1.12
tpcds_q61/duckdb:duckdb 15532454 14391823 1.08
tpcds_q62/duckdb:duckdb 10362314 9442928 1.10
tpcds_q63/duckdb:duckdb 13016548 12081174 1.08
tpcds_q64/duckdb:duckdb 56041103 55075803 1.02
tpcds_q65/duckdb:duckdb 34726885 32462679 1.07
tpcds_q66/duckdb:duckdb 26911133 25536030 1.05
tpcds_q67/duckdb:duckdb 128622758 127405407 1.01
tpcds_q68/duckdb:duckdb 26752363 25494694 1.05
tpcds_q69/duckdb:duckdb 24368099 24887154 0.98
tpcds_q70/duckdb:duckdb 14906824 14995291 0.99
tpcds_q71/duckdb:duckdb 12802142 12105163 1.06
tpcds_q72/duckdb:duckdb 43510614 43576641 1.00
tpcds_q73/duckdb:duckdb 11616542 10873089 1.07
tpcds_q74/duckdb:duckdb 148638983 141226027 1.05
tpcds_q75/duckdb:duckdb 43707354 42015396 1.04
tpcds_q76/duckdb:duckdb 12698476 11552973 1.10
tpcds_q77/duckdb:duckdb 🚨 13517375 12056554 1.12
tpcds_q78/duckdb:duckdb 64033619 61898005 1.03
tpcds_q79/duckdb:duckdb 20257298 19062669 1.06
tpcds_q80/duckdb:duckdb 27845958 26269253 1.06
tpcds_q81/duckdb:duckdb 38732982 36818861 1.05
tpcds_q82/duckdb:duckdb 9048897 8822376 1.03
tpcds_q83/duckdb:duckdb 10122784 9819827 1.03
tpcds_q84/duckdb:duckdb 🚨 15527168 13942831 1.11
tpcds_q85/duckdb:duckdb 🚨 26657030 23131660 1.15
tpcds_q86/duckdb:duckdb 11650112 10899765 1.07
tpcds_q87/duckdb:duckdb 35480576 33269591 1.07
tpcds_q88/duckdb:duckdb 26241028 25693102 1.02
tpcds_q89/duckdb:duckdb 14788343 14001661 1.06
tpcds_q90/duckdb:duckdb 5640763 5679683 0.99
tpcds_q91/duckdb:duckdb 13509441 13015322 1.04
tpcds_q92/duckdb:duckdb 8707007 8281935 1.05
tpcds_q93/duckdb:duckdb 🚨 22951670 20765833 1.11
tpcds_q94/duckdb:duckdb 13090212 13003206 1.01
tpcds_q95/duckdb:duckdb 🚀 108725252 126522030 0.86
tpcds_q96/duckdb:duckdb 4647211 4849030 0.96
tpcds_q97/duckdb:duckdb 28913216 29903220 0.97
tpcds_q98/duckdb:duckdb 14006405 13742703 1.02
tpcds_q99/duckdb:duckdb 16975591 16511689 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.9% -0.3% -3.6% +20.9% ➖ noise
1 datafusion:vortex-file-compressed -0.7% -0.3% -0.4% +18.6% ➖ noise
1 duckdb:duckdb +2.8% -0.3% +3.1% +20.5% ➖ noise
1 duckdb:vortex-compact +1.0% -0.3% +1.4% +22.0% ➖ noise
1 duckdb:vortex-file-compressed -5.0% -0.3% -4.8% +33.4% ➖ noise
2 datafusion:vortex-compact +0.2% -3.8% +4.2% +10.3% ➖ noise
2 datafusion:vortex-file-compressed +0.1% -3.8% +4.0% +10.0% ➖ noise
2 duckdb:duckdb +1.9% -3.8% +5.9% +11.8% ➖ noise
2 duckdb:vortex-compact +3.2% -3.8% +7.3% +26.2% ➖ noise
2 duckdb:vortex-file-compressed -7.0% -3.8% -3.3% +15.7% ➖ noise
3 datafusion:vortex-compact -4.3% -2.8% -1.5% +19.3% ➖ noise
3 datafusion:vortex-file-compressed +1.9% -2.8% +4.9% +10.0% ➖ noise
3 duckdb:duckdb +7.1% -2.8% +10.2% +13.1% ➖ noise
3 duckdb:vortex-compact -15.2% -2.8% -12.8% +10.0% ✅ faster
3 duckdb:vortex-file-compressed -20.2% -2.8% -17.9% +10.0% ✅ faster
4 datafusion:vortex-compact +1.8% -3.5% +5.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.3% -3.5% +6.0% +10.0% ➖ noise
4 duckdb:duckdb +7.5% -3.5% +11.4% +10.0% 🚨 regression
4 duckdb:vortex-compact +16.5% -3.5% +20.7% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +9.9% -3.5% +13.9% +11.8% 🚨 regression
5 datafusion:vortex-compact +1.4% +5.6% -4.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.3% +5.6% -5.6% +11.6% ➖ noise
5 duckdb:duckdb +4.7% +5.6% -0.8% +15.7% ➖ noise
5 duckdb:vortex-compact -11.8% +5.6% -16.5% +12.0% ✅ faster
5 duckdb:vortex-file-compressed -7.3% +5.6% -12.2% +13.9% ✅ faster
6 datafusion:vortex-compact -4.3% +3.8% -7.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.2% +3.8% -2.5% +10.7% ➖ noise
6 duckdb:duckdb +1.6% +3.8% -2.1% +13.5% ➖ noise
6 duckdb:vortex-compact -5.0% +3.8% -8.5% +11.4% ➖ noise
6 duckdb:vortex-file-compressed -0.0% +3.8% -3.7% +10.0% ➖ noise
7 datafusion:vortex-compact +5.6% +3.0% +2.6% +18.4% ➖ noise
7 datafusion:vortex-file-compressed -2.9% +3.0% -5.7% +10.0% ➖ noise
7 duckdb:duckdb +2.7% +3.0% -0.3% +16.1% ➖ noise
7 duckdb:vortex-compact -3.0% +3.0% -5.9% +15.4% ➖ noise
7 duckdb:vortex-file-compressed +1.1% +3.0% -1.9% +10.0% ➖ noise
8 datafusion:vortex-compact +0.4% -1.0% +1.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.3% -1.0% +1.3% +10.0% ➖ noise
8 duckdb:duckdb +1.7% -1.0% +2.7% +10.0% ➖ noise
8 duckdb:vortex-compact -13.4% -1.0% -12.5% +10.0% ✅ faster
8 duckdb:vortex-file-compressed -2.6% -1.0% -1.7% +25.1% ➖ noise
9 datafusion:vortex-compact -15.7% +3.0% -18.1% +10.0% ✅ faster
9 datafusion:vortex-file-compressed -12.4% +3.0% -14.9% +10.0% ✅ faster
9 duckdb:duckdb +2.1% +3.0% -0.8% +10.0% ➖ noise
9 duckdb:vortex-compact +158.2% +3.0% +150.7% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +94.6% +3.0% +88.9% +12.7% 🚨 regression
10 datafusion:vortex-compact -3.8% -2.1% -1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.4% -2.1% +4.7% +10.9% ➖ noise
10 duckdb:duckdb +12.1% -2.1% +14.5% +10.0% 🚨 regression
10 duckdb:vortex-compact -9.8% -2.1% -7.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.5% -2.1% -3.4% +10.0% ➖ noise
11 datafusion:vortex-compact -2.6% +6.8% -8.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.8% +6.8% -3.8% +10.0% ➖ noise
11 duckdb:duckdb +6.2% +6.8% -0.6% +11.0% ➖ noise
11 duckdb:vortex-compact -10.4% +6.8% -16.1% +10.0% ✅ faster
11 duckdb:vortex-file-compressed -1.2% +6.8% -7.5% +10.0% ➖ noise
12 datafusion:vortex-compact +7.3% +1.9% +5.3% +15.2% ➖ noise
12 datafusion:vortex-file-compressed +4.4% +1.9% +2.5% +11.6% ➖ noise
12 duckdb:duckdb +1.3% +1.9% -0.5% +16.3% ➖ noise
12 duckdb:vortex-compact -7.2% +1.9% -8.9% +20.8% ➖ noise
12 duckdb:vortex-file-compressed -3.7% +1.9% -5.5% +11.9% ➖ noise
13 datafusion:vortex-compact +37.8% -0.5% +38.5% +18.8% 🚨 regression
13 datafusion:vortex-file-compressed -14.4% -0.5% -14.0% +10.0% ✅ faster
13 duckdb:duckdb +6.5% -0.5% +7.0% +10.0% ➖ noise
13 duckdb:vortex-compact -8.2% -0.5% -7.8% +10.1% ➖ noise
13 duckdb:vortex-file-compressed -8.4% -0.5% -7.9% +10.0% ➖ noise
14 datafusion:vortex-compact -2.0% -0.2% -1.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.2% -0.2% -1.1% +10.0% ➖ noise
14 duckdb:duckdb +2.9% -0.2% +3.1% +10.0% ➖ noise
14 duckdb:vortex-compact -2.9% -0.2% -2.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.2% -0.2% -1.0% +10.0% ➖ noise
15 datafusion:vortex-compact -3.0% -4.2% +1.3% +14.6% ➖ noise
15 datafusion:vortex-file-compressed -1.3% -4.2% +3.0% +11.5% ➖ noise
15 duckdb:duckdb +1.5% -4.2% +5.9% +12.7% ➖ noise
15 duckdb:vortex-compact +3.6% -4.2% +8.1% +15.3% ➖ noise
15 duckdb:vortex-file-compressed -7.0% -4.2% -2.9% +12.8% ➖ noise
16 datafusion:vortex-compact -2.0% -2.1% +0.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.5% -2.1% -0.5% +11.1% ➖ noise
16 duckdb:duckdb +0.2% -2.1% +2.3% +26.0% ➖ noise
16 duckdb:vortex-compact -3.7% -2.1% -1.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -5.1% -2.1% -3.1% +11.4% ➖ noise
17 datafusion:vortex-compact +0.8% -4.7% +5.7% +10.8% ➖ noise
17 datafusion:vortex-file-compressed -0.1% -4.7% +4.8% +10.0% ➖ noise
17 duckdb:duckdb +6.7% -4.7% +11.9% +11.7% 🚨 regression
17 duckdb:vortex-compact -6.0% -4.7% -1.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.0% -4.7% +0.8% +10.0% ➖ noise
18 datafusion:vortex-compact -1.1% -6.3% +5.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.2% -6.3% +5.5% +10.0% ➖ noise
18 duckdb:duckdb +1.8% -6.3% +8.6% +10.0% ➖ noise
18 duckdb:vortex-compact +23.1% -6.3% +31.4% +15.1% 🚨 regression
18 duckdb:vortex-file-compressed +28.4% -6.3% +37.0% +12.6% 🚨 regression
19 datafusion:vortex-compact -1.1% -1.5% +0.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.3% -1.5% -2.9% +10.0% ➖ noise
19 duckdb:duckdb +0.9% -1.5% +2.5% +10.4% ➖ noise
19 duckdb:vortex-compact -14.1% -1.5% -12.8% +10.0% ✅ faster
19 duckdb:vortex-file-compressed -4.0% -1.5% -2.5% +10.0% ➖ noise
20 datafusion:vortex-compact -1.4% -0.0% -1.4% +15.5% ➖ noise
20 datafusion:vortex-file-compressed -3.0% -0.0% -3.0% +12.4% ➖ noise
20 duckdb:duckdb +4.4% -0.0% +4.4% +11.0% ➖ noise
20 duckdb:vortex-compact -1.7% -0.0% -1.7% +10.5% ➖ noise
20 duckdb:vortex-file-compressed +4.2% -0.0% +4.3% +12.8% ➖ noise
21 datafusion:vortex-compact +3.7% +3.0% +0.6% +12.7% ➖ noise
21 datafusion:vortex-file-compressed +0.8% +3.0% -2.2% +12.8% ➖ noise
21 duckdb:duckdb +4.7% +3.0% +1.6% +20.6% ➖ noise
21 duckdb:vortex-compact -0.1% +3.0% -3.0% +18.1% ➖ noise
21 duckdb:vortex-file-compressed +2.2% +3.0% -0.8% +11.7% ➖ noise
22 datafusion:vortex-compact +5.7% +0.6% +5.1% +33.9% ➖ noise
22 datafusion:vortex-file-compressed -28.8% +0.6% -29.2% +27.0% ✅ faster
22 duckdb:duckdb +4.6% +0.6% +4.0% +14.2% ➖ noise
22 duckdb:vortex-compact -0.4% +0.6% -1.0% +13.5% ➖ noise
22 duckdb:vortex-file-compressed +6.5% +0.6% +5.8% +14.7% ➖ noise
23 datafusion:vortex-compact -4.9% -1.4% -3.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +1.7% -1.4% +3.1% +10.0% ➖ noise
23 duckdb:duckdb -3.3% -1.4% -2.0% +13.8% ➖ noise
23 duckdb:vortex-compact -18.8% -1.4% -17.7% +15.2% ✅ faster
23 duckdb:vortex-file-compressed -4.2% -1.4% -2.8% +10.6% ➖ noise
24 datafusion:vortex-compact -1.1% +2.3% -3.3% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -3.6% +2.3% -5.8% +10.0% ➖ noise
24 duckdb:duckdb +12.0% +2.3% +9.6% +10.1% ➖ noise
24 duckdb:vortex-compact -10.9% +2.3% -12.9% +11.0% ✅ faster
24 duckdb:vortex-file-compressed +1.0% +2.3% -1.3% +10.0% ➖ noise
25 datafusion:vortex-compact +0.0% +0.7% -0.7% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -0.7% +0.7% -1.3% +10.0% ➖ noise
25 duckdb:duckdb +7.6% +0.7% +6.8% +10.0% ➖ noise
25 duckdb:vortex-compact -2.1% +0.7% -2.8% +11.9% ➖ noise
25 duckdb:vortex-file-compressed -0.5% +0.7% -1.2% +12.9% ➖ noise
26 datafusion:vortex-compact -0.6% +1.5% -2.0% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +2.2% +1.5% +0.8% +10.0% ➖ noise
26 duckdb:duckdb +1.5% +1.5% +0.1% +15.7% ➖ noise
26 duckdb:vortex-compact +60.5% +1.5% +58.2% +12.3% 🚨 regression
26 duckdb:vortex-file-compressed +109.4% +1.5% +106.4% +13.4% 🚨 regression
27 datafusion:vortex-compact -1.0% -1.9% +0.9% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -7.1% -1.9% -5.3% +10.0% ➖ noise
27 duckdb:duckdb -3.1% -1.9% -1.2% +19.1% ➖ noise
27 duckdb:vortex-compact +81.0% -1.9% +84.6% +10.0% 🚨 regression
27 duckdb:vortex-file-compressed +113.0% -1.9% +117.2% +10.9% 🚨 regression
28 datafusion:vortex-compact +23.7% -0.8% +24.8% +10.0% 🚨 regression
28 datafusion:vortex-file-compressed -15.2% -0.8% -14.5% +11.6% ✅ faster
28 duckdb:duckdb +1.8% -0.8% +2.6% +10.0% ➖ noise
28 duckdb:vortex-compact +274.1% -0.8% +277.2% +10.0% 🚨 regression
28 duckdb:vortex-file-compressed +92.9% -0.8% +94.5% +20.1% 🚨 regression
29 datafusion:vortex-compact -0.1% +1.0% -1.1% +14.9% ➖ noise
29 datafusion:vortex-file-compressed +2.4% +1.0% +1.4% +10.0% ➖ noise
29 duckdb:duckdb -0.9% +1.0% -1.8% +13.0% ➖ noise
29 duckdb:vortex-compact -0.3% +1.0% -1.3% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.9% +1.0% +1.0% +15.4% ➖ noise
30 datafusion:vortex-compact -5.2% -0.0% -5.1% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -1.4% -0.0% -1.3% +10.0% ➖ noise
30 duckdb:duckdb +3.1% -0.0% +3.1% +10.0% ➖ noise
30 duckdb:vortex-compact -6.2% -0.0% -6.2% +21.6% ➖ noise
30 duckdb:vortex-file-compressed -4.5% -0.0% -4.5% +10.0% ➖ noise
31 datafusion:vortex-compact -1.9% +4.2% -5.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.1% +4.2% -3.9% +10.0% ➖ noise
31 duckdb:duckdb +4.7% +4.2% +0.5% +10.0% ➖ noise
31 duckdb:vortex-compact +6.8% +4.2% +2.6% +10.8% ➖ noise
31 duckdb:vortex-file-compressed +27.4% +4.2% +22.3% +10.0% 🚨 regression
32 datafusion:vortex-compact -2.5% -0.8% -1.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.0% -0.8% -0.2% +15.2% ➖ noise
32 duckdb:duckdb +1.4% -0.8% +2.2% +12.7% ➖ noise
32 duckdb:vortex-compact -11.1% -0.8% -10.4% +17.8% ➖ noise
32 duckdb:vortex-file-compressed +1.1% -0.8% +2.0% +25.1% ➖ noise
33 datafusion:vortex-compact -2.1% -2.8% +0.8% +18.0% ➖ noise
33 datafusion:vortex-file-compressed -0.9% -2.8% +2.0% +10.0% ➖ noise
33 duckdb:duckdb -0.5% -2.8% +2.4% +13.0% ➖ noise
33 duckdb:vortex-compact -10.8% -2.8% -8.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.7% -2.8% -0.9% +10.5% ➖ noise
34 datafusion:vortex-compact +1.3% -5.6% +7.3% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -3.3% -5.6% +2.4% +10.0% ➖ noise
34 duckdb:duckdb +5.9% -5.6% +12.1% +10.8% 🚨 regression
34 duckdb:vortex-compact -6.5% -5.6% -1.0% +10.1% ➖ noise
34 duckdb:vortex-file-compressed -7.5% -5.6% -2.0% +10.0% ➖ noise
35 datafusion:vortex-compact -2.9% +1.1% -3.9% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.3% +1.1% -4.3% +10.0% ➖ noise
35 duckdb:duckdb +3.1% +1.1% +2.0% +11.0% ➖ noise
35 duckdb:vortex-compact -7.2% +1.1% -8.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -3.1% +1.1% -4.1% +10.7% ➖ noise
36 datafusion:vortex-compact -4.6% +2.3% -6.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.3% +2.3% -2.5% +10.0% ➖ noise
36 duckdb:duckdb +1.7% +2.3% -0.5% +10.0% ➖ noise
36 duckdb:vortex-compact -8.3% +2.3% -10.3% +16.0% ➖ noise
36 duckdb:vortex-file-compressed -6.2% +2.3% -8.3% +19.2% ➖ noise
37 datafusion:vortex-compact -17.9% +6.9% -23.1% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -6.5% +6.9% -12.6% +20.5% ➖ noise
37 duckdb:duckdb -4.4% +6.9% -10.5% +14.7% ➖ noise
37 duckdb:vortex-compact -5.1% +6.9% -11.2% +11.2% ✅ faster
37 duckdb:vortex-file-compressed -23.9% +6.9% -28.8% +10.4% ✅ faster
38 datafusion:vortex-compact +1.9% +0.3% +1.7% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +4.5% +0.3% +4.2% +10.0% ➖ noise
38 duckdb:duckdb +17.1% +0.3% +16.8% +15.3% 🚨 regression
38 duckdb:vortex-compact -3.2% +0.3% -3.4% +16.9% ➖ noise
38 duckdb:vortex-file-compressed +4.3% +0.3% +4.1% +13.5% ➖ noise
39 datafusion:vortex-compact -2.3% -8.1% +6.3% +10.9% ➖ noise
39 datafusion:vortex-file-compressed -4.1% -8.1% +4.4% +10.0% ➖ noise
39 duckdb:duckdb +6.4% -8.1% +15.8% +20.7% ➖ noise
39 duckdb:vortex-compact +2.4% -8.1% +11.5% +10.2% 🚨 regression
39 duckdb:vortex-file-compressed +4.4% -8.1% +13.7% +14.1% ➖ noise
40 datafusion:vortex-compact +1.1% +5.2% -3.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -0.7% +5.2% -5.6% +10.0% ➖ noise
40 duckdb:duckdb -3.7% +5.2% -8.5% +16.3% ➖ noise
40 duckdb:vortex-compact -3.5% +5.2% -8.2% +14.1% ➖ noise
40 duckdb:vortex-file-compressed -1.8% +5.2% -6.6% +14.5% ➖ noise
41 datafusion:vortex-compact -0.6% -1.4% +0.8% +13.2% ➖ noise
41 datafusion:vortex-file-compressed -2.7% -1.4% -1.3% +15.6% ➖ noise
41 duckdb:duckdb -3.0% -1.4% -1.6% +12.9% ➖ noise
41 duckdb:vortex-compact +41.3% -1.4% +43.4% +10.0% 🚨 regression
41 duckdb:vortex-file-compressed +28.6% -1.4% +30.5% +16.9% 🚨 regression
42 datafusion:vortex-compact -1.1% -0.2% -0.9% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -0.5% -0.2% -0.3% +10.0% ➖ noise
42 duckdb:duckdb +2.3% -0.2% +2.5% +14.4% ➖ noise
42 duckdb:vortex-compact -13.2% -0.2% -13.1% +13.6% ✅ faster
42 duckdb:vortex-file-compressed -5.8% -0.2% -5.6% +11.9% ➖ noise
43 datafusion:vortex-compact -1.1% -1.5% +0.3% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -2.0% -1.5% -0.5% +10.3% ➖ noise
43 duckdb:duckdb +0.2% -1.5% +1.7% +10.0% ➖ noise
43 duckdb:vortex-compact -16.5% -1.5% -15.2% +11.5% ✅ faster
43 duckdb:vortex-file-compressed -5.3% -1.5% -3.9% +10.0% ➖ noise
44 datafusion:vortex-compact -0.6% -0.6% -0.0% +12.5% ➖ noise
44 datafusion:vortex-file-compressed +3.7% -0.6% +4.3% +10.7% ➖ noise
44 duckdb:duckdb -3.0% -0.6% -2.5% +12.9% ➖ noise
44 duckdb:vortex-compact +4.0% -0.6% +4.6% +16.7% ➖ noise
44 duckdb:vortex-file-compressed -2.9% -0.6% -2.4% +11.1% ➖ noise
45 datafusion:vortex-compact -0.7% +2.6% -3.2% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -4.8% +2.6% -7.2% +10.0% ➖ noise
45 duckdb:duckdb +0.6% +2.6% -2.0% +10.0% ➖ noise
45 duckdb:vortex-compact -5.4% +2.6% -7.8% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +1.7% +2.6% -0.8% +10.0% ➖ noise
46 datafusion:vortex-compact +0.6% +2.4% -1.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -4.3% +2.4% -6.5% +10.0% ➖ noise
46 duckdb:duckdb +2.6% +2.4% +0.2% +10.0% ➖ noise
46 duckdb:vortex-compact +22.6% +2.4% +19.7% +10.0% 🚨 regression
46 duckdb:vortex-file-compressed +54.0% +2.4% +50.5% +10.0% 🚨 regression
47 datafusion:vortex-compact -2.0% +0.1% -2.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +0.4% +0.1% +0.2% +10.0% ➖ noise
47 duckdb:duckdb +1.7% +0.1% +1.6% +10.0% ➖ noise
47 duckdb:vortex-compact -13.9% +0.1% -14.0% +10.0% ✅ faster
47 duckdb:vortex-file-compressed -2.9% +0.1% -3.0% +10.0% ➖ noise
48 datafusion:vortex-compact +30.4% -0.8% +31.4% +12.2% 🚨 regression
48 datafusion:vortex-file-compressed -8.6% -0.8% -7.8% +10.0% ➖ noise
48 duckdb:duckdb +6.8% -0.8% +7.6% +12.8% ➖ noise
48 duckdb:vortex-compact -15.7% -0.8% -15.0% +10.0% ✅ faster
48 duckdb:vortex-file-compressed -7.4% -0.8% -6.6% +10.5% ➖ noise
49 datafusion:vortex-compact +0.2% -2.7% +3.0% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -2.1% -2.7% +0.6% +10.0% ➖ noise
49 duckdb:duckdb -2.5% -2.7% +0.2% +14.1% ➖ noise
49 duckdb:vortex-compact -0.0% -2.7% +2.8% +12.7% ➖ noise
49 duckdb:vortex-file-compressed +6.7% -2.7% +9.7% +15.2% ➖ noise
50 datafusion:vortex-compact +8.4% -0.9% +9.4% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +0.3% -0.9% +1.2% +10.0% ➖ noise
50 duckdb:duckdb +3.3% -0.9% +4.3% +11.7% ➖ noise
50 duckdb:vortex-compact -12.2% -0.9% -11.4% +10.0% ✅ faster
50 duckdb:vortex-file-compressed +0.4% -0.9% +1.3% +10.0% ➖ noise
51 datafusion:vortex-compact -0.1% -2.4% +2.3% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -2.8% -2.4% -0.4% +10.0% ➖ noise
51 duckdb:duckdb +4.0% -2.4% +6.6% +10.0% ➖ noise
51 duckdb:vortex-compact -3.3% -2.4% -1.0% +17.8% ➖ noise
51 duckdb:vortex-file-compressed +17.8% -2.4% +20.7% +20.0% 🚨 regression
52 datafusion:vortex-compact +1.0% -0.2% +1.2% +17.4% ➖ noise
52 datafusion:vortex-file-compressed -1.7% -0.2% -1.6% +13.9% ➖ noise
52 duckdb:duckdb +3.3% -0.2% +3.5% +17.2% ➖ noise
52 duckdb:vortex-compact -13.7% -0.2% -13.5% +12.8% ✅ faster
52 duckdb:vortex-file-compressed -10.7% -0.2% -10.6% +13.2% ➖ noise
53 datafusion:vortex-compact +1.3% -0.3% +1.6% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +1.4% -0.3% +1.7% +11.5% ➖ noise
53 duckdb:duckdb +3.7% -0.3% +4.0% +15.3% ➖ noise
53 duckdb:vortex-compact -17.0% -0.3% -16.8% +13.6% ✅ faster
53 duckdb:vortex-file-compressed -3.2% -0.3% -2.9% +18.8% ➖ noise
54 datafusion:vortex-compact +2.9% +3.9% -0.9% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +4.1% +3.9% +0.2% +14.5% ➖ noise
54 duckdb:duckdb -1.2% +3.9% -4.9% +11.8% ➖ noise
54 duckdb:vortex-compact -13.0% +3.9% -16.2% +10.0% ✅ faster
54 duckdb:vortex-file-compressed +1.7% +3.9% -2.1% +10.0% ➖ noise
55 datafusion:vortex-compact +0.3% -1.5% +1.9% +10.2% ➖ noise
55 datafusion:vortex-file-compressed -3.2% -1.5% -1.7% +10.0% ➖ noise
55 duckdb:duckdb +1.8% -1.5% +3.4% +16.6% ➖ noise
55 duckdb:vortex-compact -8.4% -1.5% -7.0% +11.9% ➖ noise
55 duckdb:vortex-file-compressed -8.7% -1.5% -7.2% +10.0% ➖ noise
56 datafusion:vortex-compact +2.0% +0.2% +1.7% +12.6% ➖ noise
56 datafusion:vortex-file-compressed -0.1% +0.2% -0.3% +12.3% ➖ noise
56 duckdb:duckdb -1.1% +0.2% -1.3% +10.0% ➖ noise
56 duckdb:vortex-compact -11.2% +0.2% -11.4% +10.0% ✅ faster
56 duckdb:vortex-file-compressed -13.6% +0.2% -13.8% +15.4% ✅ faster
57 datafusion:vortex-compact -0.5% -1.9% +1.4% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -0.3% -1.9% +1.6% +10.0% ➖ noise
57 duckdb:duckdb +1.2% -1.9% +3.2% +10.0% ➖ noise
57 duckdb:vortex-compact -2.6% -1.9% -0.7% +13.3% ➖ noise
57 duckdb:vortex-file-compressed +1.4% -1.9% +3.4% +12.0% ➖ noise
58 datafusion:vortex-compact -3.8% -1.1% -2.8% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -5.6% -1.1% -4.5% +10.0% ➖ noise
58 duckdb:duckdb +8.0% -1.1% +9.2% +10.9% ➖ noise
58 duckdb:vortex-compact -7.1% -1.1% -6.1% +14.5% ➖ noise
58 duckdb:vortex-file-compressed -6.8% -1.1% -5.8% +14.1% ➖ noise
59 datafusion:vortex-compact -3.5% +0.3% -3.8% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -0.1% +0.3% -0.4% +10.0% ➖ noise
59 duckdb:duckdb +4.8% +0.3% +4.4% +10.0% ➖ noise
59 duckdb:vortex-compact +0.5% +0.3% +0.2% +10.3% ➖ noise
59 duckdb:vortex-file-compressed -0.4% +0.3% -0.7% +10.0% ➖ noise
60 datafusion:vortex-compact +1.9% +4.9% -2.8% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +3.1% +4.9% -1.6% +10.0% ➖ noise
60 duckdb:duckdb +11.8% +4.9% +6.7% +14.0% ➖ noise
60 duckdb:vortex-compact -13.3% +4.9% -17.4% +12.5% ✅ faster
60 duckdb:vortex-file-compressed -11.2% +4.9% -15.3% +11.7% ✅ faster
61 datafusion:vortex-compact -2.0% -3.3% +1.3% +12.3% ➖ noise
61 datafusion:vortex-file-compressed -0.6% -3.3% +2.8% +10.0% ➖ noise
61 duckdb:duckdb +7.9% -3.3% +11.6% +10.0% 🚨 regression
61 duckdb:vortex-compact -21.8% -3.3% -19.1% +10.5% ✅ faster
61 duckdb:vortex-file-compressed -2.4% -3.3% +0.9% +12.6% ➖ noise
62 datafusion:vortex-compact +12.4% +11.7% +0.6% +29.2% ➖ noise
62 datafusion:vortex-file-compressed +12.7% +11.7% +0.9% +22.5% ➖ noise
62 duckdb:duckdb +9.7% +11.7% -1.8% +15.9% ➖ noise
62 duckdb:vortex-compact -18.5% +11.7% -27.0% +21.0% ✅ faster
62 duckdb:vortex-file-compressed -0.6% +11.7% -11.0% +19.1% ➖ noise
63 datafusion:vortex-compact -2.4% +1.6% -3.9% +19.7% ➖ noise
63 datafusion:vortex-file-compressed +0.5% +1.6% -1.1% +10.0% ➖ noise
63 duckdb:duckdb +7.7% +1.6% +6.1% +10.0% ➖ noise
63 duckdb:vortex-compact -16.7% +1.6% -18.0% +13.5% ✅ faster
63 duckdb:vortex-file-compressed -7.7% +1.6% -9.1% +10.0% ✅ faster
64 datafusion:vortex-compact +1.2% +1.3% -0.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.8% +1.3% -2.1% +10.0% ➖ noise
64 duckdb:duckdb +1.8% +1.3% +0.4% +10.0% ➖ noise
64 duckdb:vortex-compact -24.7% +1.3% -25.7% +10.0% ✅ faster
64 duckdb:vortex-file-compressed -26.6% +1.3% -27.5% +10.0% ✅ faster
65 datafusion:vortex-compact -6.0% +0.7% -6.6% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -1.9% +0.7% -2.6% +20.3% ➖ noise
65 duckdb:duckdb +7.0% +0.7% +6.2% +10.7% ➖ noise
65 duckdb:vortex-compact -4.2% +0.7% -4.9% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +4.5% +0.7% +3.8% +17.8% ➖ noise
66 datafusion:vortex-compact +3.3% +2.7% +0.6% +13.8% ➖ noise
66 datafusion:vortex-file-compressed -6.0% +2.7% -8.5% +10.0% ➖ noise
66 duckdb:duckdb +5.4% +2.7% +2.6% +12.3% ➖ noise
66 duckdb:vortex-compact -0.5% +2.7% -3.1% +12.7% ➖ noise
66 duckdb:vortex-file-compressed -2.7% +2.7% -5.2% +12.9% ➖ noise
67 datafusion:vortex-compact -0.2% -0.6% +0.3% +11.4% ➖ noise
67 datafusion:vortex-file-compressed +2.7% -0.6% +3.3% +15.0% ➖ noise
67 duckdb:duckdb +1.0% -0.6% +1.5% +10.0% ➖ noise
67 duckdb:vortex-compact -0.7% -0.6% -0.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -0.2% -0.6% +0.4% +10.0% ➖ noise
68 datafusion:vortex-compact -0.6% -0.9% +0.4% +12.7% ➖ noise
68 datafusion:vortex-file-compressed -1.0% -0.9% -0.1% +10.0% ➖ noise
68 duckdb:duckdb +4.9% -0.9% +5.9% +10.0% ➖ noise
68 duckdb:vortex-compact +3.7% -0.9% +4.7% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +8.6% -0.9% +9.6% +15.7% ➖ noise
69 datafusion:vortex-compact -0.8% +0.3% -1.1% +16.8% ➖ noise
69 datafusion:vortex-file-compressed -1.2% +0.3% -1.6% +10.0% ➖ noise
69 duckdb:duckdb -2.1% +0.3% -2.4% +10.0% ➖ noise
69 duckdb:vortex-compact -10.9% +0.3% -11.2% +10.0% ✅ faster
69 duckdb:vortex-file-compressed -8.2% +0.3% -8.5% +10.0% ➖ noise
70 datafusion:vortex-compact -3.4% +3.0% -6.2% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -2.5% +3.0% -5.3% +12.2% ➖ noise
70 duckdb:duckdb -0.6% +3.0% -3.5% +12.2% ➖ noise
70 duckdb:vortex-compact -53.0% +3.0% -54.4% +10.9% ✅ faster
70 duckdb:vortex-file-compressed -35.2% +3.0% -37.1% +12.1% ✅ faster
71 datafusion:vortex-compact +1.9% -1.2% +3.1% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +1.5% -1.2% +2.7% +20.7% ➖ noise
71 duckdb:duckdb +5.8% -1.2% +7.0% +21.2% ➖ noise
71 duckdb:vortex-compact -12.4% -1.2% -11.3% +13.0% ➖ noise
71 duckdb:vortex-file-compressed -2.3% -1.2% -1.1% +10.0% ➖ noise
72 datafusion:vortex-compact +0.5% +0.1% +0.4% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -0.7% +0.1% -0.8% +10.0% ➖ noise
72 duckdb:duckdb -0.2% +0.1% -0.2% +15.3% ➖ noise
72 duckdb:vortex-compact +11.0% +0.1% +10.9% +10.0% 🚨 regression
72 duckdb:vortex-file-compressed +2.7% +0.1% +2.6% +10.0% ➖ noise
73 datafusion:vortex-compact -0.1% -1.1% +1.0% +10.0% ➖ noise
73 datafusion:vortex-file-compressed -4.1% -1.1% -3.0% +10.0% ➖ noise
73 duckdb:duckdb +6.8% -1.1% +8.1% +12.7% ➖ noise
73 duckdb:vortex-compact -6.2% -1.1% -5.1% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -9.9% -1.1% -8.8% +10.0% ➖ noise
74 datafusion:vortex-compact -0.4% +1.0% -1.4% +13.0% ➖ noise
74 datafusion:vortex-file-compressed -1.7% +1.0% -2.6% +15.8% ➖ noise
74 duckdb:duckdb +5.2% +1.0% +4.2% +10.0% ➖ noise
74 duckdb:vortex-compact +56.0% +1.0% +54.5% +13.6% 🚨 regression
74 duckdb:vortex-file-compressed +76.1% +1.0% +74.4% +14.8% 🚨 regression
75 datafusion:vortex-compact +0.8% +2.3% -1.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -1.0% +2.3% -3.2% +10.0% ➖ noise
75 duckdb:duckdb +4.0% +2.3% +1.6% +10.0% ➖ noise
75 duckdb:vortex-compact +5.1% +2.3% +2.7% +12.8% ➖ noise
75 duckdb:vortex-file-compressed +20.2% +2.3% +17.4% +10.0% 🚨 regression
76 datafusion:vortex-compact -1.3% +2.9% -4.0% +17.7% ➖ noise
76 datafusion:vortex-file-compressed -1.0% +2.9% -3.8% +10.0% ➖ noise
76 duckdb:duckdb +9.9% +2.9% +6.8% +14.4% ➖ noise
76 duckdb:vortex-compact -3.4% +2.9% -6.1% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +1.4% +2.9% -1.4% +10.0% ➖ noise
77 datafusion:vortex-compact +1.8% +4.1% -2.2% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -2.7% +4.1% -6.5% +12.4% ➖ noise
77 duckdb:duckdb +12.1% +4.1% +7.7% +10.9% ➖ noise
77 duckdb:vortex-compact -13.9% +4.1% -17.3% +10.0% ✅ faster
77 duckdb:vortex-file-compressed -8.3% +4.1% -11.9% +10.0% ✅ faster
78 datafusion:vortex-compact -1.0% -1.2% +0.2% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -1.9% -1.2% -0.7% +10.0% ➖ noise
78 duckdb:duckdb +3.5% -1.2% +4.7% +12.7% ➖ noise
78 duckdb:vortex-compact -6.9% -1.2% -5.7% +10.4% ➖ noise
78 duckdb:vortex-file-compressed -0.3% -1.2% +0.9% +10.0% ➖ noise
79 datafusion:vortex-compact +0.4% +2.8% -2.3% +14.7% ➖ noise
79 datafusion:vortex-file-compressed +2.0% +2.8% -0.8% +10.0% ➖ noise
79 duckdb:duckdb +6.3% +2.8% +3.4% +14.4% ➖ noise
79 duckdb:vortex-compact +1.3% +2.8% -1.5% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +19.2% +2.8% +15.9% +10.0% 🚨 regression
80 datafusion:vortex-compact -5.7% -1.0% -4.7% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +1.1% -1.0% +2.2% +10.7% ➖ noise
80 duckdb:duckdb +6.0% -1.0% +7.1% +15.2% ➖ noise
80 duckdb:vortex-compact -13.2% -1.0% -12.2% +20.8% ➖ noise
80 duckdb:vortex-file-compressed -7.7% -1.0% -6.7% +10.0% ➖ noise
81 datafusion:vortex-compact -0.0% +1.3% -1.3% +12.4% ➖ noise
81 datafusion:vortex-file-compressed +2.5% +1.3% +1.2% +11.3% ➖ noise
81 duckdb:duckdb +5.2% +1.3% +3.8% +10.7% ➖ noise
81 duckdb:vortex-compact -1.5% +1.3% -2.8% +10.9% ➖ noise
81 duckdb:vortex-file-compressed -7.4% +1.3% -8.7% +13.0% ➖ noise
82 datafusion:vortex-compact -13.8% +2.4% -15.8% +15.4% ✅ faster
82 datafusion:vortex-file-compressed -8.6% +2.4% -10.7% +11.7% ✅ faster
82 duckdb:duckdb +2.6% +2.4% +0.2% +12.3% ➖ noise
82 duckdb:vortex-compact -54.3% +2.4% -55.4% +10.1% ✅ faster
82 duckdb:vortex-file-compressed -68.3% +2.4% -69.0% +18.7% ✅ faster
83 datafusion:vortex-compact +0.5% -0.6% +1.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -0.8% -0.6% -0.2% +10.0% ➖ noise
83 duckdb:duckdb +3.1% -0.6% +3.7% +12.4% ➖ noise
83 duckdb:vortex-compact -13.6% -0.6% -13.1% +19.8% ➖ noise
83 duckdb:vortex-file-compressed -12.3% -0.6% -11.8% +10.0% ✅ faster
84 datafusion:vortex-compact +0.7% +0.6% +0.1% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +0.8% +0.6% +0.2% +10.0% ➖ noise
84 duckdb:duckdb +11.4% +0.6% +10.7% +12.2% ➖ noise
84 duckdb:vortex-compact -1.1% +0.6% -1.7% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +2.8% +0.6% +2.2% +10.0% ➖ noise
85 datafusion:vortex-compact +29.7% +1.1% +28.3% +15.8% 🚨 regression
85 datafusion:vortex-file-compressed -4.8% +1.1% -5.9% +10.3% ➖ noise
85 duckdb:duckdb +15.2% +1.1% +13.9% +14.4% ➖ noise
85 duckdb:vortex-compact +0.4% +1.1% -0.8% +10.4% ➖ noise
85 duckdb:vortex-file-compressed +1.3% +1.1% +0.1% +10.0% ➖ noise
86 datafusion:vortex-compact -17.3% -4.2% -13.7% +19.9% ➖ noise
86 datafusion:vortex-file-compressed +8.3% -4.2% +13.0% +17.3% ➖ noise
86 duckdb:duckdb +6.9% -4.2% +11.6% +15.0% ➖ noise
86 duckdb:vortex-compact -10.7% -4.2% -6.8% +16.0% ➖ noise
86 duckdb:vortex-file-compressed -3.3% -4.2% +0.9% +14.4% ➖ noise
87 datafusion:vortex-compact -0.8% -0.7% -0.0% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -3.8% -0.7% -3.1% +10.0% ➖ noise
87 duckdb:duckdb +6.6% -0.7% +7.4% +10.8% ➖ noise
87 duckdb:vortex-compact -2.2% -0.7% -1.5% +10.6% ➖ noise
87 duckdb:vortex-file-compressed +6.4% -0.7% +7.1% +11.2% ➖ noise
88 datafusion:vortex-compact -2.2% +0.5% -2.6% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.6% +0.5% +0.1% +10.0% ➖ noise
88 duckdb:duckdb +2.1% +0.5% +1.7% +10.0% ➖ noise
88 duckdb:vortex-compact -55.5% +0.5% -55.7% +10.0% ✅ faster
88 duckdb:vortex-file-compressed -44.5% +0.5% -44.8% +10.0% ✅ faster
89 datafusion:vortex-compact +2.4% -1.6% +4.0% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +0.2% -1.6% +1.8% +11.8% ➖ noise
89 duckdb:duckdb +5.6% -1.6% +7.3% +10.6% ➖ noise
89 duckdb:vortex-compact -14.2% -1.6% -12.9% +10.0% ✅ faster
89 duckdb:vortex-file-compressed -7.0% -1.6% -5.5% +10.0% ➖ noise
90 datafusion:vortex-compact -2.5% -1.3% -1.2% +26.8% ➖ noise
90 datafusion:vortex-file-compressed -1.1% -1.3% +0.2% +10.0% ➖ noise
90 duckdb:duckdb -0.7% -1.3% +0.6% +12.9% ➖ noise
90 duckdb:vortex-compact +32.6% -1.3% +34.4% +21.8% 🚨 regression
90 duckdb:vortex-file-compressed +20.8% -1.3% +22.4% +10.0% 🚨 regression
91 datafusion:vortex-compact -0.5% +0.2% -0.7% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +3.5% +0.2% +3.2% +10.0% ➖ noise
91 duckdb:duckdb +3.8% +0.2% +3.6% +12.6% ➖ noise
91 duckdb:vortex-compact +1.5% +0.2% +1.3% +13.6% ➖ noise
91 duckdb:vortex-file-compressed +20.3% +0.2% +20.0% +10.0% 🚨 regression
92 datafusion:vortex-compact -0.8% -0.7% -0.0% +18.5% ➖ noise
92 datafusion:vortex-file-compressed -1.1% -0.7% -0.4% +10.0% ➖ noise
92 duckdb:duckdb +5.1% -0.7% +5.9% +11.2% ➖ noise
92 duckdb:vortex-compact +0.8% -0.7% +1.5% +17.4% ➖ noise
92 duckdb:vortex-file-compressed -10.9% -0.7% -10.3% +18.1% ➖ noise
93 datafusion:vortex-compact +0.7% +4.3% -3.4% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -3.0% +4.3% -7.0% +10.0% ➖ noise
93 duckdb:duckdb +10.5% +4.3% +6.0% +15.1% ➖ noise
93 duckdb:vortex-compact +0.9% +4.3% -3.3% +12.0% ➖ noise
93 duckdb:vortex-file-compressed +6.5% +4.3% +2.2% +11.9% ➖ noise
94 datafusion:vortex-compact -3.2% -1.3% -1.9% +13.2% ➖ noise
94 datafusion:vortex-file-compressed -8.5% -1.3% -7.3% +15.6% ➖ noise
94 duckdb:duckdb +0.7% -1.3% +2.0% +10.5% ➖ noise
94 duckdb:vortex-compact -13.6% -1.3% -12.5% +10.3% ✅ faster
94 duckdb:vortex-file-compressed -5.1% -1.3% -3.8% +15.9% ➖ noise
95 datafusion:vortex-compact +0.5% +10.5% -9.0% +11.1% ➖ noise
95 datafusion:vortex-file-compressed -0.8% +10.5% -10.2% +10.3% ✅ faster
95 duckdb:duckdb -14.1% +10.5% -22.2% +19.1% ✅ faster
95 duckdb:vortex-compact +7.5% +10.5% -2.7% +19.5% ➖ noise
95 duckdb:vortex-file-compressed +2.6% +10.5% -7.1% +14.2% ➖ noise
96 datafusion:vortex-compact +0.6% +0.4% +0.2% +11.1% ➖ noise
96 datafusion:vortex-file-compressed -1.2% +0.4% -1.5% +10.0% ➖ noise
96 duckdb:duckdb -4.2% +0.4% -4.5% +17.1% ➖ noise
96 duckdb:vortex-compact -6.5% +0.4% -6.8% +11.4% ➖ noise
96 duckdb:vortex-file-compressed -6.6% +0.4% -6.9% +22.9% ➖ noise
97 datafusion:vortex-compact -3.1% -2.6% -0.5% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +3.6% -2.6% +6.4% +11.5% ➖ noise
97 duckdb:duckdb -3.3% -2.6% -0.8% +10.3% ➖ noise
97 duckdb:vortex-compact -14.6% -2.6% -12.3% +13.9% ✅ faster
97 duckdb:vortex-file-compressed +4.5% -2.6% +7.2% +10.0% ➖ noise
98 datafusion:vortex-compact +1.2% +2.0% -0.7% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +1.5% +2.0% -0.5% +12.9% ➖ noise
98 duckdb:duckdb +1.9% +2.0% -0.1% +12.0% ➖ noise
98 duckdb:vortex-compact -10.2% +2.0% -12.0% +10.0% ✅ faster
98 duckdb:vortex-file-compressed -9.6% +2.0% -11.4% +10.0% ✅ faster
99 datafusion:vortex-compact -15.9% -5.4% -11.1% +30.8% ➖ noise
99 datafusion:vortex-file-compressed -0.1% -5.4% +5.5% +28.7% ➖ noise
99 duckdb:duckdb +2.8% -5.4% +8.6% +34.7% ➖ noise
99 duckdb:vortex-compact -9.0% -5.4% -3.9% +21.9% ➖ noise
99 duckdb:vortex-file-compressed -5.1% -5.4% +0.3% +24.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.6%
Vortex (geomean): 1.144x ➖
Parquet (geomean): 1.174x ➖
Shifts: Parquet (control) +17.4% · Median polish +9.8%

datafusion / vortex-file-compressed (1.203x ➖, 0↑ 2↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36283068 34074790 1.06
fineweb_q01/datafusion:vortex-file-compressed 🚨 986684042 540205929 1.83
fineweb_q02/datafusion:vortex-file-compressed 🚨 878880196 400650548 2.19
fineweb_q03/datafusion:vortex-file-compressed 1497693922 1377788366 1.09
fineweb_q04/datafusion:vortex-file-compressed 1379693027 1361740254 1.01
fineweb_q05/datafusion:vortex-file-compressed 1388986517 1349846390 1.03
fineweb_q06/datafusion:vortex-file-compressed 1497956951 1545985728 0.97
fineweb_q07/datafusion:vortex-file-compressed 1414149049 1314604732 1.08
fineweb_q08/datafusion:vortex-file-compressed 498272612 475956850 1.05
datafusion / vortex-compact (1.081x ➖, 0↑ 2↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33581639 38170222 0.88
fineweb_q01/datafusion:vortex-compact 🚨 779423741 530276248 1.47
fineweb_q02/datafusion:vortex-compact 🚨 737753589 542406983 1.36
fineweb_q03/datafusion:vortex-compact 1389235734 1352810993 1.03
fineweb_q04/datafusion:vortex-compact 1566101359 1579005114 0.99
fineweb_q05/datafusion:vortex-compact 1358542485 1313916080 1.03
fineweb_q06/datafusion:vortex-compact 1391146774 1360203155 1.02
fineweb_q07/datafusion:vortex-compact 1260389481 1361106848 0.93
fineweb_q08/datafusion:vortex-compact 462693841 401709539 1.15
datafusion / parquet (1.256x ➖, 0↑ 4↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1347716801 1009772769 1.33
fineweb_q01/datafusion:parquet 2039851977 1777259459 1.15
fineweb_q02/datafusion:parquet 1900176467 1725080526 1.10
fineweb_q03/datafusion:parquet 2255154183 1753757468 1.29
fineweb_q04/datafusion:parquet 🚨 2435857347 1739857899 1.40
fineweb_q05/datafusion:parquet 1930247374 1669081273 1.16
fineweb_q06/datafusion:parquet 🚨 2724808317 1796286262 1.52
fineweb_q07/datafusion:parquet 🚨 2368566949 1790905181 1.32
fineweb_q08/datafusion:parquet 1937742427 1761807738 1.10
duckdb / vortex-file-compressed (1.155x ➖, 0↑ 1↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 97159247 80603404 1.21
fineweb_q01/duckdb:vortex-file-compressed 672863824 549476109 1.22
fineweb_q02/duckdb:vortex-file-compressed 🚨 620208666 469972885 1.32
fineweb_q03/duckdb:vortex-file-compressed 1542561085 1494558557 1.03
fineweb_q04/duckdb:vortex-file-compressed 1677995405 1491056726 1.13
fineweb_q05/duckdb:vortex-file-compressed 1775055552 1495493124 1.19
fineweb_q06/duckdb:vortex-file-compressed 1812656505 1678695433 1.08
fineweb_q07/duckdb:vortex-file-compressed 1606527039 1472274725 1.09
fineweb_q08/duckdb:vortex-file-compressed 702301197 608935895 1.15
duckdb / vortex-compact (1.139x ➖, 0↑ 2↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 87576304 56154325 1.56
fineweb_q01/duckdb:vortex-compact 🚨 664254023 507496380 1.31
fineweb_q02/duckdb:vortex-compact 602557512 624699316 0.96
fineweb_q03/duckdb:vortex-compact 1771025986 1658828292 1.07
fineweb_q04/duckdb:vortex-compact 1952438393 1765265218 1.11
fineweb_q05/duckdb:vortex-compact 1632094274 1491186102 1.09
fineweb_q06/duckdb:vortex-compact 1567755933 1467936077 1.07
fineweb_q07/duckdb:vortex-compact 1548781279 1331471096 1.16
fineweb_q08/duckdb:vortex-compact 483145499 473165861 1.02
duckdb / parquet (1.098x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1208824600 1025297848 1.18
fineweb_q01/duckdb:parquet 1383342594 1291515340 1.07
fineweb_q02/duckdb:parquet 1412269714 1304624841 1.08
fineweb_q03/duckdb:parquet 3593275056 3477496030 1.03
fineweb_q04/duckdb:parquet 2082527583 1873872195 1.11
fineweb_q05/duckdb:parquet 2299033696 2044151881 1.12
fineweb_q06/duckdb:parquet 4636701839 4136129116 1.12
fineweb_q07/duckdb:parquet 2721547919 2527482259 1.08
fineweb_q08/duckdb:parquet 1128680252 1041043948 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -12.0% +25.4% -29.9% +184.1% ➖ noise
0 datafusion:vortex-file-compressed +6.5% +25.4% -15.1% +246.3% ➖ noise
0 duckdb:vortex-compact +56.0% +25.4% +24.3% +60.8% ➖ noise
0 duckdb:vortex-file-compressed +20.5% +25.4% -3.9% +39.9% ➖ noise
1 datafusion:vortex-compact +47.0% +10.9% +32.6% +94.2% ➖ noise
1 datafusion:vortex-file-compressed +82.6% +10.9% +64.7% +73.9% ➖ noise
1 duckdb:vortex-compact +30.9% +10.9% +18.0% +40.3% ➖ noise
1 duckdb:vortex-file-compressed +22.5% +10.9% +10.4% +30.0% ➖ noise
2 datafusion:vortex-compact +36.0% +9.2% +24.6% +35.2% ➖ noise
2 datafusion:vortex-file-compressed +119.4% +9.2% +100.9% +49.7% 🚨 regression
2 duckdb:vortex-compact -3.5% +9.2% -11.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +32.0% +9.2% +20.9% +43.3% ➖ noise
3 datafusion:vortex-compact +2.7% +15.3% -10.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +8.7% +15.3% -5.7% +30.0% ➖ noise
3 duckdb:vortex-compact +6.8% +15.3% -7.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +3.2% +15.3% -10.5% +30.0% ➖ noise
4 datafusion:vortex-compact -0.8% +24.7% -20.5% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.3% +24.7% -18.8% +30.0% ➖ noise
4 duckdb:vortex-compact +10.6% +24.7% -11.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +12.5% +24.7% -9.8% +30.0% ➖ noise
5 datafusion:vortex-compact +3.4% +14.0% -9.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.9% +14.0% -9.8% +30.0% ➖ noise
5 duckdb:vortex-compact +9.4% +14.0% -4.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +18.7% +14.0% +4.1% +30.0% ➖ noise
6 datafusion:vortex-compact +2.3% +30.4% -21.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -3.1% +30.4% -25.7% +30.0% ✅ faster
6 duckdb:vortex-compact +6.8% +30.4% -18.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +8.0% +30.4% -17.2% +30.0% ➖ noise
7 datafusion:vortex-compact -7.4% +19.3% -22.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +7.6% +19.3% -9.9% +30.0% ➖ noise
7 duckdb:vortex-compact +16.3% +19.3% -2.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +9.1% +19.3% -8.6% +30.0% ➖ noise
8 datafusion:vortex-compact +15.2% +9.2% +5.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +4.7% +9.2% -4.1% +30.0% ➖ noise
8 duckdb:vortex-compact +2.1% +9.2% -6.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +15.3% +9.2% +5.6% +30.0% ➖ noise

@joseph-isaacs joseph-isaacs merged commit 254f91b into develop May 15, 2026
62 checks passed
@joseph-isaacs joseph-isaacs deleted the ji/fix-try-opt-bench branch May 15, 2026 14:53
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: Random Access

Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.975x ➖

unknown / unknown (0.969x ➖, 2↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2264409 2811028 0.81
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1457681 1476546 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8168302540 8021058885 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8260416200 8176586103 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7703360 7883649 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7017032 7455045 0.94
random-access/feature-vectors/uniform/lance-tokio-local-disk 5763328 5819001 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6543068 6619098 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8298287449 8265728753 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8238074760 8308655581 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13144434 13334322 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13020789 13238601 0.98
random-access/lance-tokio-local-disk 743300 758551 0.98
random-access/lance-tokio-local-disk-footer 1293618 1320578 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 252900 253908 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 618317 636020 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 126258093 128865831 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 126069075 128474573 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 549213 604125 0.91
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 564743 579147 0.98
random-access/nested-lists/uniform/lance-tokio-local-disk 1082767 1090488 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1461286 1481228 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk 126186244 128763268 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 126050759 128516819 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk 2070661 2089448 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2055628 2068275 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk 392573 396246 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 586655 598857 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk 19801064 21818441 0.91
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 19636390 21696049 0.91
random-access/nested-structs/correlated/vortex-tokio-local-disk 714073 764731 0.93
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 725988 754428 0.96
random-access/nested-structs/uniform/lance-tokio-local-disk 2660013 2660868 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2871107 2893112 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk 19836459 21729994 0.91
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 20135868 21404239 0.94
random-access/nested-structs/uniform/vortex-tokio-local-disk 1545686 1619329 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1613984 1584763 1.02
random-access/parquet-tokio-local-disk 164423890 165819715 0.99
random-access/parquet-tokio-local-disk-footer 164629554 164951542 1.00
random-access/taxi/correlated/lance-tokio-local-disk 929647 952544 0.98
random-access/taxi/correlated/lance-tokio-local-disk-footer 1554551 1596378 0.97
random-access/taxi/correlated/parquet-tokio-local-disk 245882440 247577080 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 244897333 246552143 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1496749 1790113 0.84
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1682959 1790103 0.94
random-access/taxi/uniform/lance-tokio-local-disk 9494090 9507751 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 10129703 10149608 1.00
random-access/taxi/uniform/parquet-tokio-local-disk 259104991 262714550 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 260812684 264712709 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 4408450 4566202 0.97
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4375033 4531734 0.97
random-access/vortex-tokio-local-disk 1138080 1197949 0.95
random-access/vortex-tokio-local-disk-footer 1162175 1268121 0.92

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 1.110x ❌
Parquet (geomean): 1.103x ❌
Shifts: Parquet (control) +10.3% · Median polish +9.9%

duckdb / vortex-file-compressed (1.126x ❌, 0↑ 5↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚨 12601721 11326910 1.11
statpopgen_q01/duckdb:vortex-file-compressed 🚨 28819818 19202630 1.50
statpopgen_q02/duckdb:vortex-file-compressed 1497393964 1396425205 1.07
statpopgen_q03/duckdb:vortex-file-compressed 🚨 3531925451 3129053740 1.13
statpopgen_q04/duckdb:vortex-file-compressed 3433402150 3132569452 1.10
statpopgen_q05/duckdb:vortex-file-compressed 1546494495 1449976317 1.07
statpopgen_q06/duckdb:vortex-file-compressed 2307234269 2133746749 1.08
statpopgen_q07/duckdb:vortex-file-compressed 🚨 225876143 204353768 1.11
statpopgen_q08/duckdb:vortex-file-compressed 255288632 237835817 1.07
statpopgen_q09/duckdb:vortex-file-compressed 3181597417 2910738510 1.09
statpopgen_q10/duckdb:vortex-file-compressed 🚨 5247749826 4704626166 1.12
duckdb / vortex-compact (1.094x ➖, 0↑ 4↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚨 12591626 11099955 1.13
statpopgen_q01/duckdb:vortex-compact 184247553 172720205 1.07
statpopgen_q02/duckdb:vortex-compact 2002662645 1826866847 1.10
statpopgen_q03/duckdb:vortex-compact 🚨 3945999986 3504293986 1.13
statpopgen_q04/duckdb:vortex-compact 🚨 3922144788 3549332934 1.11
statpopgen_q05/duckdb:vortex-compact 2016922006 1846141734 1.09
statpopgen_q06/duckdb:vortex-compact 2927690303 2664723791 1.10
statpopgen_q07/duckdb:vortex-compact 939205351 893407853 1.05
statpopgen_q08/duckdb:vortex-compact 968043424 916155896 1.06
statpopgen_q09/duckdb:vortex-compact 3689707109 3378795599 1.09
statpopgen_q10/duckdb:vortex-compact 🚨 6067729718 5409129166 1.12
duckdb / parquet (1.103x ❌, 0↑ 7↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 343527893 328029625 1.05
statpopgen_q01/duckdb:parquet 430306854 403608651 1.07
statpopgen_q02/duckdb:parquet 1071165777 981088881 1.09
statpopgen_q03/duckdb:parquet 🚨 1655035539 1478826621 1.12
statpopgen_q04/duckdb:parquet 🚨 1650836886 1486083317 1.11
statpopgen_q05/duckdb:parquet 🚨 1107266907 1005546261 1.10
statpopgen_q06/duckdb:parquet 🚨 1666647270 1496757559 1.11
statpopgen_q07/duckdb:parquet 🚨 1451681563 1288595257 1.13
statpopgen_q08/duckdb:parquet 🚨 1466259885 1290653067 1.14
statpopgen_q09/duckdb:parquet 1530255181 1413209722 1.08
statpopgen_q10/duckdb:parquet 🚨 3060270608 2685084865 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +13.4% +4.7% +8.3% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +11.3% +4.7% +6.2% +10.6% ➖ noise
1 duckdb:vortex-compact +6.7% +6.6% +0.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +50.1% +6.6% +40.8% +198.7% ➖ noise
2 duckdb:vortex-compact +9.6% +9.2% +0.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +7.2% +9.2% -1.8% +10.0% ➖ noise
3 duckdb:vortex-compact +12.6% +11.9% +0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +12.9% +11.9% +0.9% +10.0% ➖ noise
4 duckdb:vortex-compact +10.5% +11.1% -0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +9.6% +11.1% -1.3% +10.0% ➖ noise
5 duckdb:vortex-compact +9.3% +10.1% -0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.7% +10.1% -3.1% +10.0% ➖ noise
6 duckdb:vortex-compact +9.9% +11.4% -1.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +8.1% +11.4% -2.9% +10.0% ➖ noise
7 duckdb:vortex-compact +5.1% +12.7% -6.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +10.5% +12.7% -1.9% +10.0% ➖ noise
8 duckdb:vortex-compact +5.7% +13.6% -7.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +7.3% +13.6% -5.5% +10.0% ➖ noise
9 duckdb:vortex-compact +9.2% +8.3% +0.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +9.3% +8.3% +0.9% +10.0% ➖ noise
10 duckdb:vortex-compact +12.2% +14.0% -1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +11.5% +14.0% -2.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.5%

datafusion / vortex-file-compressed (0.990x ➖, 1↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1747778 1638553 1.07
clickbench_q01/datafusion:vortex-file-compressed 18542223 18994163 0.98
clickbench_q02/datafusion:vortex-file-compressed 37534044 37334331 1.01
clickbench_q03/datafusion:vortex-file-compressed 42171360 40868730 1.03
clickbench_q04/datafusion:vortex-file-compressed 284102989 277212272 1.02
clickbench_q05/datafusion:vortex-file-compressed 305159457 301041970 1.01
clickbench_q06/datafusion:vortex-file-compressed 1650177 1692298 0.98
clickbench_q07/datafusion:vortex-file-compressed 21808257 22986996 0.95
clickbench_q08/datafusion:vortex-file-compressed 352062957 349631992 1.01
clickbench_q09/datafusion:vortex-file-compressed 539017410 568308142 0.95
clickbench_q10/datafusion:vortex-file-compressed 73439520 72636407 1.01
clickbench_q11/datafusion:vortex-file-compressed 81570231 86317231 0.95
clickbench_q12/datafusion:vortex-file-compressed 264139582 270812854 0.98
clickbench_q13/datafusion:vortex-file-compressed 404688369 410525532 0.99
clickbench_q14/datafusion:vortex-file-compressed 250326260 251480655 1.00
clickbench_q15/datafusion:vortex-file-compressed 326812041 323615561 1.01
clickbench_q16/datafusion:vortex-file-compressed 631609187 644649480 0.98
clickbench_q17/datafusion:vortex-file-compressed 630422643 632435589 1.00
clickbench_q18/datafusion:vortex-file-compressed 1271312386 1275784113 1.00
clickbench_q19/datafusion:vortex-file-compressed 🚀 28875711 33888504 0.85
clickbench_q20/datafusion:vortex-file-compressed 338618952 341708696 0.99
clickbench_q21/datafusion:vortex-file-compressed 365635994 367026976 1.00
clickbench_q22/datafusion:vortex-file-compressed 443615897 444303979 1.00
clickbench_q23/datafusion:vortex-file-compressed 668114018 608989563 1.10
clickbench_q24/datafusion:vortex-file-compressed 47421484 43297520 1.10
clickbench_q25/datafusion:vortex-file-compressed 68233513 73587608 0.93
clickbench_q26/datafusion:vortex-file-compressed 43769280 42939417 1.02
clickbench_q27/datafusion:vortex-file-compressed 700653210 741791485 0.94
clickbench_q28/datafusion:vortex-file-compressed 6742699916 6524462881 1.03
clickbench_q29/datafusion:vortex-file-compressed 225602815 230443445 0.98
clickbench_q30/datafusion:vortex-file-compressed 216193055 213977643 1.01
clickbench_q31/datafusion:vortex-file-compressed 250147698 251946036 0.99
clickbench_q32/datafusion:vortex-file-compressed 1098233966 1119084564 0.98
clickbench_q33/datafusion:vortex-file-compressed 1290040429 1284312571 1.00
clickbench_q34/datafusion:vortex-file-compressed 1282231675 1289112231 0.99
clickbench_q35/datafusion:vortex-file-compressed 442454603 439279483 1.01
clickbench_q36/datafusion:vortex-file-compressed 66978375 69516201 0.96
clickbench_q37/datafusion:vortex-file-compressed 34620429 34062181 1.02
clickbench_q38/datafusion:vortex-file-compressed 17576566 18644744 0.94
clickbench_q39/datafusion:vortex-file-compressed 129469286 132230686 0.98
clickbench_q40/datafusion:vortex-file-compressed 15112747 15594973 0.97
clickbench_q41/datafusion:vortex-file-compressed 14363122 14967356 0.96
clickbench_q42/datafusion:vortex-file-compressed 16185242 16709465 0.97
datafusion / parquet (0.996x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1594622 1591386 1.00
clickbench_q01/datafusion:parquet 18679967 18961325 0.99
clickbench_q02/datafusion:parquet 46954657 46534201 1.01
clickbench_q03/datafusion:parquet 36659170 37819689 0.97
clickbench_q04/datafusion:parquet 292543929 306368168 0.95
clickbench_q05/datafusion:parquet 350011615 345095055 1.01
clickbench_q06/datafusion:parquet 1542701 1517883 1.02
clickbench_q07/datafusion:parquet 22980205 22189695 1.04
clickbench_q08/datafusion:parquet 367546018 362217915 1.01
clickbench_q09/datafusion:parquet 607840374 628439221 0.97
clickbench_q10/datafusion:parquet 103160354 103499107 1.00
clickbench_q11/datafusion:parquet 128813101 128475740 1.00
clickbench_q12/datafusion:parquet 338477065 342964763 0.99
clickbench_q13/datafusion:parquet 482815640 472609202 1.02
clickbench_q14/datafusion:parquet 335911759 338318968 0.99
clickbench_q15/datafusion:parquet 330820192 334356069 0.99
clickbench_q16/datafusion:parquet 649766962 644234575 1.01
clickbench_q17/datafusion:parquet 635857141 634946211 1.00
clickbench_q18/datafusion:parquet 1294779103 1310554414 0.99
clickbench_q19/datafusion:parquet 28606041 29129194 0.98
clickbench_q20/datafusion:parquet 592954096 600767795 0.99
clickbench_q21/datafusion:parquet 648741241 659964919 0.98
clickbench_q22/datafusion:parquet 957442926 955150907 1.00
clickbench_q23/datafusion:parquet 3539066045 3582678251 0.99
clickbench_q24/datafusion:parquet 79208531 81632871 0.97
clickbench_q25/datafusion:parquet 130223740 132861012 0.98
clickbench_q26/datafusion:parquet 84122684 81853927 1.03
clickbench_q27/datafusion:parquet 1036471810 1042587897 0.99
clickbench_q28/datafusion:parquet 6329887803 6584537758 0.96
clickbench_q29/datafusion:parquet 239447427 237570747 1.01
clickbench_q30/datafusion:parquet 319934866 328525254 0.97
clickbench_q31/datafusion:parquet 361464278 353562672 1.02
clickbench_q32/datafusion:parquet 1210240630 1173904862 1.03
clickbench_q33/datafusion:parquet 1447392888 1457352822 0.99
clickbench_q34/datafusion:parquet 1466239458 1465045706 1.00
clickbench_q35/datafusion:parquet 452465161 461827101 0.98
clickbench_q36/datafusion:parquet 133779490 140778431 0.95
clickbench_q37/datafusion:parquet 57972662 55167077 1.05
clickbench_q38/datafusion:parquet 83254174 83831040 0.99
clickbench_q39/datafusion:parquet 254191997 255107132 1.00
clickbench_q40/datafusion:parquet 30641818 29692097 1.03
clickbench_q41/datafusion:parquet 26845370 27303583 0.98
clickbench_q42/datafusion:parquet 29049065 29296308 0.99
duckdb / vortex-file-compressed (1.041x ➖, 1↑ 9↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 5994527 6713771 0.89
clickbench_q01/duckdb:vortex-file-compressed 12765786 12045485 1.06
clickbench_q02/duckdb:vortex-file-compressed 25270254 24856408 1.02
clickbench_q03/duckdb:vortex-file-compressed 29487342 29869154 0.99
clickbench_q04/duckdb:vortex-file-compressed 179430944 180185558 1.00
clickbench_q05/duckdb:vortex-file-compressed 172494333 177493603 0.97
clickbench_q06/duckdb:vortex-file-compressed 20173000 20677488 0.98
clickbench_q07/duckdb:vortex-file-compressed 13644156 14920395 0.91
clickbench_q08/duckdb:vortex-file-compressed 254647656 253526943 1.00
clickbench_q09/duckdb:vortex-file-compressed 329911975 334731199 0.99
clickbench_q10/duckdb:vortex-file-compressed 64234231 64718459 0.99
clickbench_q11/duckdb:vortex-file-compressed 74680759 76515192 0.98
clickbench_q12/duckdb:vortex-file-compressed 200640118 191835595 1.05
clickbench_q13/duckdb:vortex-file-compressed 399839187 390253228 1.02
clickbench_q14/duckdb:vortex-file-compressed 224430550 230323330 0.97
clickbench_q15/duckdb:vortex-file-compressed 242496123 239873583 1.01
clickbench_q16/duckdb:vortex-file-compressed 581201471 576719992 1.01
clickbench_q17/duckdb:vortex-file-compressed 475670042 464758666 1.02
clickbench_q18/duckdb:vortex-file-compressed 985404241 958322563 1.03
clickbench_q19/duckdb:vortex-file-compressed 20006163 21287600 0.94
clickbench_q20/duckdb:vortex-file-compressed 314429329 332688286 0.95
clickbench_q21/duckdb:vortex-file-compressed 366050874 359695312 1.02
clickbench_q22/duckdb:vortex-file-compressed 552214903 608265804 0.91
clickbench_q23/duckdb:vortex-file-compressed 🚨 319044396 184564143 1.73
clickbench_q24/duckdb:vortex-file-compressed 36860364 33587278 1.10
clickbench_q25/duckdb:vortex-file-compressed 🚨 78937485 66104438 1.19
clickbench_q26/duckdb:vortex-file-compressed 🚨 42578302 36521206 1.17
clickbench_q27/duckdb:vortex-file-compressed 468962833 467171764 1.00
clickbench_q28/duckdb:vortex-file-compressed 2957899283 2967403428 1.00
clickbench_q29/duckdb:vortex-file-compressed 28339780 28018391 1.01
clickbench_q30/duckdb:vortex-file-compressed 187036815 181337962 1.03
clickbench_q31/duckdb:vortex-file-compressed 277269192 279392640 0.99
clickbench_q32/duckdb:vortex-file-compressed 1207112255 1182527861 1.02
clickbench_q33/duckdb:vortex-file-compressed 1122386526 1158903667 0.97
clickbench_q34/duckdb:vortex-file-compressed 1203932884 1244533422 0.97
clickbench_q35/duckdb:vortex-file-compressed 374344027 383812957 0.98
clickbench_q36/duckdb:vortex-file-compressed 🚨 26894125 23812153 1.13
clickbench_q37/duckdb:vortex-file-compressed 🚨 20184135 16428380 1.23
clickbench_q38/duckdb:vortex-file-compressed 🚨 22579524 18581262 1.22
clickbench_q39/duckdb:vortex-file-compressed 38396608 36593986 1.05
clickbench_q40/duckdb:vortex-file-compressed 🚨 20414877 16779439 1.22
clickbench_q41/duckdb:vortex-file-compressed 🚨 19780955 16421285 1.20
clickbench_q42/duckdb:vortex-file-compressed 🚨 20470374 17098997 1.20
duckdb / parquet (0.985x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23994633 25366876 0.95
clickbench_q01/duckdb:parquet 27306229 26785076 1.02
clickbench_q02/duckdb:parquet 49383548 48691604 1.01
clickbench_q03/duckdb:parquet 37262111 38150219 0.98
clickbench_q04/duckdb:parquet 199748578 203800576 0.98
clickbench_q05/duckdb:parquet 269391101 278739468 0.97
clickbench_q06/duckdb:parquet 46013319 47396831 0.97
clickbench_q07/duckdb:parquet 28648544 28792688 0.99
clickbench_q08/duckdb:parquet 263076043 269103800 0.98
clickbench_q09/duckdb:parquet 390226072 395802402 0.99
clickbench_q10/duckdb:parquet 79187514 81442266 0.97
clickbench_q11/duckdb:parquet 97420644 99176741 0.98
clickbench_q12/duckdb:parquet 289353130 292246856 0.99
clickbench_q13/duckdb:parquet 476671916 474112113 1.01
clickbench_q14/duckdb:parquet 326929667 324097478 1.01
clickbench_q15/duckdb:parquet 250805406 261301110 0.96
clickbench_q16/duckdb:parquet 648931750 640313937 1.01
clickbench_q17/duckdb:parquet 541241880 546980517 0.99
clickbench_q18/duckdb:parquet 1078640425 1064743670 1.01
clickbench_q19/duckdb:parquet 25904431 25382233 1.02
clickbench_q20/duckdb:parquet 422559408 421864130 1.00
clickbench_q21/duckdb:parquet 542708623 548127590 0.99
clickbench_q22/duckdb:parquet 925352437 927316559 1.00
clickbench_q23/duckdb:parquet 299877389 294314050 1.02
clickbench_q24/duckdb:parquet 66916384 67980244 0.98
clickbench_q25/duckdb:parquet 156444258 157574877 0.99
clickbench_q26/duckdb:parquet 48934632 51381972 0.95
clickbench_q27/duckdb:parquet 639877591 644389087 0.99
clickbench_q28/duckdb:parquet 4807732647 4856275971 0.99
clickbench_q29/duckdb:parquet 40450740 41244999 0.98
clickbench_q30/duckdb:parquet 299779044 300435637 1.00
clickbench_q31/duckdb:parquet 360940379 362291796 1.00
clickbench_q32/duckdb:parquet 1148369943 1154800375 0.99
clickbench_q33/duckdb:parquet 1199834892 1298115008 0.92
clickbench_q34/duckdb:parquet 1243112095 1341809688 0.93
clickbench_q35/duckdb:parquet 361163321 365948819 0.99
clickbench_q36/duckdb:parquet 44080767 47671247 0.92
clickbench_q37/duckdb:parquet 31398785 32308897 0.97
clickbench_q38/duckdb:parquet 33923552 34092979 1.00
clickbench_q39/duckdb:parquet 86199911 85024612 1.01
clickbench_q40/duckdb:parquet 17208238 17231611 1.00
clickbench_q41/duckdb:parquet 18407450 18550944 0.99
clickbench_q42/duckdb:parquet 20046097 21134062 0.95
duckdb / duckdb (0.998x ➖, 1↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 16943988 17875291 0.95
clickbench_q01/duckdb:duckdb 33450673 32289190 1.04
clickbench_q02/duckdb:duckdb 43943599 45455838 0.97
clickbench_q03/duckdb:duckdb 47246198 47097448 1.00
clickbench_q04/duckdb:duckdb 185846722 189706504 0.98
clickbench_q05/duckdb:duckdb 264991699 266225502 1.00
clickbench_q06/duckdb:duckdb 🚀 28668501 35773529 0.80
clickbench_q07/duckdb:duckdb 35354262 35603607 0.99
clickbench_q08/duckdb:duckdb 249551347 248172176 1.01
clickbench_q09/duckdb:duckdb 364788135 368232078 0.99
clickbench_q10/duckdb:duckdb 97835863 97137098 1.01
clickbench_q11/duckdb:duckdb 108191345 105787648 1.02
clickbench_q12/duckdb:duckdb 238000836 236269525 1.01
clickbench_q13/duckdb:duckdb 471669993 484014882 0.97
clickbench_q14/duckdb:duckdb 276637903 277671528 1.00
clickbench_q15/duckdb:duckdb 218494346 218839360 1.00
clickbench_q16/duckdb:duckdb 644894667 644043058 1.00
clickbench_q17/duckdb:duckdb 558508511 538665239 1.04
clickbench_q18/duckdb:duckdb 1222382372 1199781018 1.02
clickbench_q19/duckdb:duckdb 34005057 34560130 0.98
clickbench_q20/duckdb:duckdb 1073697507 1051341872 1.02
clickbench_q21/duckdb:duckdb 1088189315 1108331583 0.98
clickbench_q22/duckdb:duckdb 1154093605 1052336323 1.10
clickbench_q23/duckdb:duckdb 260272940 257091181 1.01
clickbench_q24/duckdb:duckdb 61476690 60963719 1.01
clickbench_q25/duckdb:duckdb 144752927 141974682 1.02
clickbench_q26/duckdb:duckdb 61996048 60088099 1.03
clickbench_q27/duckdb:duckdb 1021508909 1051522958 0.97
clickbench_q28/duckdb:duckdb 4693250098 4593475224 1.02
clickbench_q29/duckdb:duckdb 48077858 47816119 1.01
clickbench_q30/duckdb:duckdb 260396089 261427104 1.00
clickbench_q31/duckdb:duckdb 415656708 414220975 1.00
clickbench_q32/duckdb:duckdb 1481440488 1442405457 1.03
clickbench_q33/duckdb:duckdb 2005577984 1885002161 1.06
clickbench_q34/duckdb:duckdb 2016468479 2125326996 0.95
clickbench_q35/duckdb:duckdb 278970567 282514004 0.99
clickbench_q36/duckdb:duckdb 38908562 41737894 0.93
clickbench_q37/duckdb:duckdb 31717211 29747267 1.07
clickbench_q38/duckdb:duckdb 30259408 32101809 0.94
clickbench_q39/duckdb:duckdb 69168231 65572699 1.05
clickbench_q40/duckdb:duckdb 31368463 31280487 1.00
clickbench_q41/duckdb:duckdb 29667746 29692991 1.00
clickbench_q42/duckdb:duckdb 31354265 31417607 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +6.7% -2.6% +9.6% +794.5% ➖ noise
0 duckdb:duckdb -5.2% -2.6% -2.6% +290.3% ➖ noise
0 duckdb:vortex-file-compressed -10.7% -2.6% -8.3% +465.2% ➖ noise
1 datafusion:vortex-file-compressed -2.4% +0.2% -2.6% +22.5% ➖ noise
1 duckdb:duckdb +3.6% +0.2% +3.4% +71.6% ➖ noise
1 duckdb:vortex-file-compressed +6.0% +0.2% +5.8% +22.4% ➖ noise
2 datafusion:vortex-file-compressed +0.5% +1.2% -0.6% +12.4% ➖ noise
2 duckdb:duckdb -3.3% +1.2% -4.4% +26.5% ➖ noise
2 duckdb:vortex-file-compressed +1.7% +1.2% +0.5% +15.8% ➖ noise
3 datafusion:vortex-file-compressed +3.2% -2.7% +6.0% +149.0% ➖ noise
3 duckdb:duckdb +0.3% -2.7% +3.1% +54.5% ➖ noise
3 duckdb:vortex-file-compressed -1.3% -2.7% +1.5% +100.9% ➖ noise
4 datafusion:vortex-file-compressed +2.5% -3.3% +5.9% +10.0% ➖ noise
4 duckdb:duckdb -2.0% -3.3% +1.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.4% -3.3% +2.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.4% -1.0% +2.4% +10.0% ➖ noise
5 duckdb:duckdb -0.5% -1.0% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.8% -1.0% -1.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.5% -0.7% -1.8% +39.5% ➖ noise
6 duckdb:duckdb -19.9% -0.7% -19.3% +29.1% ➖ noise
6 duckdb:vortex-file-compressed -2.4% -0.7% -1.8% +21.7% ➖ noise
7 datafusion:vortex-file-compressed -5.1% +1.5% -6.5% +18.7% ➖ noise
7 duckdb:duckdb -0.7% +1.5% -2.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -8.6% +1.5% -9.9% +10.0% ✅ faster
8 datafusion:vortex-file-compressed +0.7% -0.4% +1.1% +10.0% ➖ noise
8 duckdb:duckdb +0.6% -0.4% +1.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% -0.4% +0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -5.2% -2.3% -2.9% +10.0% ➖ noise
9 duckdb:duckdb -0.9% -2.3% +1.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% -2.3% +0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.1% -1.6% +2.7% +10.0% ➖ noise
10 duckdb:duckdb +0.7% -1.6% +2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% -1.6% +0.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -5.5% -0.8% -4.8% +10.0% ➖ noise
11 duckdb:duckdb +2.3% -0.8% +3.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.4% -0.8% -1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.5% -1.1% -1.3% +10.0% ➖ noise
12 duckdb:duckdb +0.7% -1.1% +1.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +4.6% -1.1% +5.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.4% +1.3% -2.7% +10.0% ➖ noise
13 duckdb:duckdb -2.6% +1.3% -3.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.5% +1.3% +1.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.5% +0.1% -0.5% +10.0% ➖ noise
14 duckdb:duckdb -0.4% +0.1% -0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.6% +0.1% -2.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.0% -2.5% +3.6% +10.0% ➖ noise
15 duckdb:duckdb -0.2% -2.5% +2.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.1% -2.5% +3.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.0% +1.1% -3.1% +10.0% ➖ noise
16 duckdb:duckdb +0.1% +1.1% -1.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.8% +1.1% -0.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.3% -0.5% +0.1% +10.0% ➖ noise
17 duckdb:duckdb +3.7% -0.5% +4.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.3% -0.5% +2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.4% +0.0% -0.4% +10.0% ➖ noise
18 duckdb:duckdb +1.9% +0.0% +1.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.8% +0.0% +2.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -14.8% +0.1% -14.9% +27.4% ➖ noise
19 duckdb:duckdb -1.6% +0.1% -1.7% +15.1% ➖ noise
19 duckdb:vortex-file-compressed -6.0% +0.1% -6.1% +18.0% ➖ noise
20 datafusion:vortex-file-compressed -0.9% -0.6% -0.3% +208.6% ➖ noise
20 duckdb:duckdb +2.1% -0.6% +2.7% +24.7% ➖ noise
20 duckdb:vortex-file-compressed -5.5% -0.6% -4.9% +105.4% ➖ noise
21 datafusion:vortex-file-compressed -0.4% -1.3% +1.0% +10.0% ➖ noise
21 duckdb:duckdb -1.8% -1.3% -0.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.8% -1.3% +3.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.2% +0.0% -0.2% +14.8% ➖ noise
22 duckdb:duckdb +9.7% +0.0% +9.7% +15.2% ➖ noise
22 duckdb:vortex-file-compressed -9.2% +0.0% -9.2% +16.8% ➖ noise
23 datafusion:vortex-file-compressed +9.7% +0.3% +9.4% +53.8% ➖ noise
23 duckdb:duckdb +1.2% +0.3% +0.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +72.9% +0.3% +72.3% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +9.5% -2.3% +12.1% +16.5% ➖ noise
24 duckdb:duckdb +0.8% -2.3% +3.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +9.7% -2.3% +12.3% +27.6% ➖ noise
25 datafusion:vortex-file-compressed -7.3% -1.4% -6.0% +10.0% ➖ noise
25 duckdb:duckdb +2.0% -1.4% +3.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +19.4% -1.4% +21.1% +12.5% 🚨 regression
26 datafusion:vortex-file-compressed +1.9% -1.1% +3.0% +10.0% ➖ noise
26 duckdb:duckdb +3.2% -1.1% +4.3% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +16.6% -1.1% +17.8% +20.2% ➖ noise
27 datafusion:vortex-file-compressed -5.5% -0.6% -4.9% +10.0% ➖ noise
27 duckdb:duckdb -2.9% -0.6% -2.2% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.4% -0.6% +1.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +3.3% -2.4% +5.9% +10.0% ➖ noise
28 duckdb:duckdb +2.2% -2.4% +4.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.3% -2.4% +2.2% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.1% -0.6% -1.5% +10.0% ➖ noise
29 duckdb:duckdb +0.5% -0.6% +1.1% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.1% -0.6% +1.7% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +1.0% -1.4% +2.5% +10.0% ➖ noise
30 duckdb:duckdb -0.4% -1.4% +1.0% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +3.1% -1.4% +4.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.7% +0.9% -1.6% +10.0% ➖ noise
31 duckdb:duckdb +0.3% +0.9% -0.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.8% +0.9% -1.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.9% +1.3% -3.1% +10.0% ➖ noise
32 duckdb:duckdb +2.7% +1.3% +1.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +2.1% +1.3% +0.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.4% -4.2% +4.8% +10.0% ➖ noise
33 duckdb:duckdb +6.4% -4.2% +11.0% +10.3% 🚨 regression
33 duckdb:vortex-file-compressed -3.2% -4.2% +1.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -0.5% -3.7% +3.3% +10.0% ➖ noise
34 duckdb:duckdb -5.1% -3.7% -1.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.3% -3.7% +0.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.7% -1.7% +2.4% +10.0% ➖ noise
35 duckdb:duckdb -1.3% -1.7% +0.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.5% -1.7% -0.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -3.7% -6.3% +2.8% +12.3% ➖ noise
36 duckdb:duckdb -6.8% -6.3% -0.6% +12.9% ➖ noise
36 duckdb:vortex-file-compressed +12.9% -6.3% +20.5% +15.7% 🚨 regression
37 datafusion:vortex-file-compressed +1.6% +1.1% +0.6% +10.0% ➖ noise
37 duckdb:duckdb +6.6% +1.1% +5.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +22.9% +1.1% +21.6% +11.7% 🚨 regression
38 datafusion:vortex-file-compressed -5.7% -0.6% -5.2% +10.0% ➖ noise
38 duckdb:duckdb -5.7% -0.6% -5.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +21.5% -0.6% +22.2% +10.0% 🚨 regression
39 datafusion:vortex-file-compressed -2.1% +0.5% -2.6% +10.8% ➖ noise
39 duckdb:duckdb +5.5% +0.5% +5.0% +20.8% ➖ noise
39 duckdb:vortex-file-compressed +4.9% +0.5% +4.4% +13.6% ➖ noise
40 datafusion:vortex-file-compressed -3.1% +1.5% -4.5% +12.0% ➖ noise
40 duckdb:duckdb +0.3% +1.5% -1.2% +10.6% ➖ noise
40 duckdb:vortex-file-compressed +21.7% +1.5% +19.8% +11.3% 🚨 regression
41 datafusion:vortex-file-compressed -4.0% -1.2% -2.8% +14.4% ➖ noise
41 duckdb:duckdb -0.1% -1.2% +1.2% +19.0% ➖ noise
41 duckdb:vortex-file-compressed +20.5% -1.2% +22.0% +13.3% 🚨 regression
42 datafusion:vortex-file-compressed -3.1% -3.0% -0.1% +10.0% ➖ noise
42 duckdb:duckdb -0.2% -3.0% +2.9% +17.8% ➖ noise
42 duckdb:vortex-file-compressed +19.7% -3.0% +23.4% +16.6% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.6%
Vortex (geomean): 1.181x ➖
Parquet (geomean): 1.162x ➖
Shifts: Parquet (control) +16.2% · Median polish +16.8%

datafusion / vortex-file-compressed (1.263x ➖, 0↑ 10↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 393971281 262085516 1.50
tpch_q02/datafusion:vortex-file-compressed 🚨 724975735 430241716 1.69
tpch_q03/datafusion:vortex-file-compressed 574717149 447560885 1.28
tpch_q04/datafusion:vortex-file-compressed 300970490 296519188 1.02
tpch_q05/datafusion:vortex-file-compressed 🚨 582972231 439941846 1.33
tpch_q06/datafusion:vortex-file-compressed 351984698 387098808 0.91
tpch_q07/datafusion:vortex-file-compressed 🚨 549499844 379379845 1.45
tpch_q08/datafusion:vortex-file-compressed 🚨 799593347 560017506 1.43
tpch_q09/datafusion:vortex-file-compressed 🚨 511401486 390807589 1.31
tpch_q10/datafusion:vortex-file-compressed 542304762 436025019 1.24
tpch_q11/datafusion:vortex-file-compressed 329731902 270858756 1.22
tpch_q12/datafusion:vortex-file-compressed 515659985 459396177 1.12
tpch_q13/datafusion:vortex-file-compressed 157644069 148876789 1.06
tpch_q14/datafusion:vortex-file-compressed 236072591 260501892 0.91
tpch_q15/datafusion:vortex-file-compressed 467315241 457298665 1.02
tpch_q16/datafusion:vortex-file-compressed 248204818 191525605 1.30
tpch_q17/datafusion:vortex-file-compressed 🚨 650939334 328813286 1.98
tpch_q18/datafusion:vortex-file-compressed 🚨 451346735 310489398 1.45
tpch_q19/datafusion:vortex-file-compressed 🚨 561262777 412559686 1.36
tpch_q20/datafusion:vortex-file-compressed 443070097 421491262 1.05
tpch_q21/datafusion:vortex-file-compressed 673979826 533130116 1.26
tpch_q22/datafusion:vortex-file-compressed 🚨 157650285 112643756 1.40
datafusion / vortex-compact (1.204x ➖, 0↑ 7↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 283033274 259656108 1.09
tpch_q02/datafusion:vortex-compact 472450928 414673077 1.14
tpch_q03/datafusion:vortex-compact 400690613 374445461 1.07
tpch_q04/datafusion:vortex-compact 245373634 236927050 1.04
tpch_q05/datafusion:vortex-compact 🚨 512360726 360614278 1.42
tpch_q06/datafusion:vortex-compact 406004372 324800641 1.25
tpch_q07/datafusion:vortex-compact 🚨 571319588 377083034 1.52
tpch_q08/datafusion:vortex-compact 563311935 491381070 1.15
tpch_q09/datafusion:vortex-compact 421770318 389427625 1.08
tpch_q10/datafusion:vortex-compact 438311733 441888537 0.99
tpch_q11/datafusion:vortex-compact 282536802 267512065 1.06
tpch_q12/datafusion:vortex-compact 🚨 579075621 437037257 1.33
tpch_q13/datafusion:vortex-compact 🚨 191152169 133303905 1.43
tpch_q14/datafusion:vortex-compact 🚨 412058850 257614352 1.60
tpch_q15/datafusion:vortex-compact 🚨 721679533 496466236 1.45
tpch_q16/datafusion:vortex-compact 🚨 249220977 184891969 1.35
tpch_q17/datafusion:vortex-compact 405440408 335882239 1.21
tpch_q18/datafusion:vortex-compact 382365928 314221507 1.22
tpch_q19/datafusion:vortex-compact 556969534 448286590 1.24
tpch_q20/datafusion:vortex-compact 488662862 462481741 1.06
tpch_q21/datafusion:vortex-compact 569130590 500668761 1.14
tpch_q22/datafusion:vortex-compact 106161551 111580876 0.95
datafusion / parquet (1.160x ➖, 0↑ 5↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 257911655 231248232 1.12
tpch_q02/datafusion:parquet 506772786 402120313 1.26
tpch_q03/datafusion:parquet 358717505 321079716 1.12
tpch_q04/datafusion:parquet 🚨 208714499 151924595 1.37
tpch_q05/datafusion:parquet 461432581 453118072 1.02
tpch_q06/datafusion:parquet 141001141 132606392 1.06
tpch_q07/datafusion:parquet 482747021 425171143 1.14
tpch_q08/datafusion:parquet 564161389 534869461 1.05
tpch_q09/datafusion:parquet 465797227 443763061 1.05
tpch_q10/datafusion:parquet 483772693 468192509 1.03
tpch_q11/datafusion:parquet 325323182 314931962 1.03
tpch_q12/datafusion:parquet 🚨 306331565 218215496 1.40
tpch_q13/datafusion:parquet 446642956 430847709 1.04
tpch_q14/datafusion:parquet 177956476 182090249 0.98
tpch_q15/datafusion:parquet 305986297 295435325 1.04
tpch_q16/datafusion:parquet 187217556 166733968 1.12
tpch_q17/datafusion:parquet 464850212 375407619 1.24
tpch_q18/datafusion:parquet 505942070 461947966 1.10
tpch_q19/datafusion:parquet 374798346 320105666 1.17
tpch_q20/datafusion:parquet 🚨 456643582 320551389 1.42
tpch_q21/datafusion:parquet 🚨 809750063 526223071 1.54
tpch_q22/datafusion:parquet 🚨 163814817 113818265 1.44
duckdb / vortex-file-compressed (1.125x ➖, 1↑ 1↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 297643817 257438942 1.16
tpch_q02/duckdb:vortex-file-compressed 1119364894 876459578 1.28
tpch_q03/duckdb:vortex-file-compressed 762131215 644034354 1.18
tpch_q04/duckdb:vortex-file-compressed 430733900 350089097 1.23
tpch_q05/duckdb:vortex-file-compressed 936303881 760239966 1.23
tpch_q06/duckdb:vortex-file-compressed 409472482 329343664 1.24
tpch_q07/duckdb:vortex-file-compressed 950428027 879000425 1.08
tpch_q08/duckdb:vortex-file-compressed 999754580 917117037 1.09
tpch_q09/duckdb:vortex-file-compressed 901626545 855996084 1.05
tpch_q10/duckdb:vortex-file-compressed 756810571 730182786 1.04
tpch_q11/duckdb:vortex-file-compressed 521702048 464439366 1.12
tpch_q12/duckdb:vortex-file-compressed 🚀 445552237 758434898 0.59
tpch_q13/duckdb:vortex-file-compressed 465182125 458025117 1.02
tpch_q14/duckdb:vortex-file-compressed 398795546 369287706 1.08
tpch_q15/duckdb:vortex-file-compressed 304835713 253170106 1.20
tpch_q16/duckdb:vortex-file-compressed 373829915 322811070 1.16
tpch_q17/duckdb:vortex-file-compressed 693734585 620136137 1.12
tpch_q18/duckdb:vortex-file-compressed 590754365 468818562 1.26
tpch_q19/duckdb:vortex-file-compressed 554928590 449406198 1.23
tpch_q20/duckdb:vortex-file-compressed 820532115 775855217 1.06
tpch_q21/duckdb:vortex-file-compressed 1196389833 965967011 1.24
tpch_q22/duckdb:vortex-file-compressed 🚨 360777064 263346244 1.37
duckdb / vortex-compact (1.137x ➖, 0↑ 2↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 309783172 261084603 1.19
tpch_q02/duckdb:vortex-compact 980060240 866735387 1.13
tpch_q03/duckdb:vortex-compact 657253627 573897678 1.15
tpch_q04/duckdb:vortex-compact 391390460 359347036 1.09
tpch_q05/duckdb:vortex-compact 797585145 755172480 1.06
tpch_q06/duckdb:vortex-compact 411740881 334133392 1.23
tpch_q07/duckdb:vortex-compact 765443721 828000847 0.92
tpch_q08/duckdb:vortex-compact 983319539 852079227 1.15
tpch_q09/duckdb:vortex-compact 932743997 856479350 1.09
tpch_q10/duckdb:vortex-compact 669546852 601531605 1.11
tpch_q11/duckdb:vortex-compact 525213789 425947520 1.23
tpch_q12/duckdb:vortex-compact 486452556 571747746 0.85
tpch_q13/duckdb:vortex-compact 439055549 432689523 1.01
tpch_q14/duckdb:vortex-compact 471051017 392316775 1.20
tpch_q15/duckdb:vortex-compact 🚨 340718833 246790922 1.38
tpch_q16/duckdb:vortex-compact 374035391 332087167 1.13
tpch_q17/duckdb:vortex-compact 648230136 565400409 1.15
tpch_q18/duckdb:vortex-compact 531884536 446565602 1.19
tpch_q19/duckdb:vortex-compact 473367039 424220325 1.12
tpch_q20/duckdb:vortex-compact 747240068 695106265 1.08
tpch_q21/duckdb:vortex-compact 1100618361 847654547 1.30
tpch_q22/duckdb:vortex-compact 🚨 347864158 246182271 1.41
duckdb / parquet (1.165x ➖, 0↑ 1↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 449141410 413046464 1.09
tpch_q02/duckdb:parquet 1107941574 953585162 1.16
tpch_q03/duckdb:parquet 1117751984 886964975 1.26
tpch_q04/duckdb:parquet 674131121 583790630 1.15
tpch_q05/duckdb:parquet 1321599654 1069716562 1.24
tpch_q06/duckdb:parquet 456220803 421962884 1.08
tpch_q07/duckdb:parquet 1310206830 1036239734 1.26
tpch_q08/duckdb:parquet 1464752961 1349852000 1.09
tpch_q09/duckdb:parquet 1500058993 1232774831 1.22
tpch_q10/duckdb:parquet 1321468359 1165231690 1.13
tpch_q11/duckdb:parquet 736323993 683715742 1.08
tpch_q12/duckdb:parquet 🚨 844809602 598961362 1.41
tpch_q13/duckdb:parquet 955086927 830109071 1.15
tpch_q14/duckdb:parquet 713418462 675218568 1.06
tpch_q15/duckdb:parquet 575968806 497338213 1.16
tpch_q16/duckdb:parquet 676458893 563278985 1.20
tpch_q17/duckdb:parquet 810742268 700017009 1.16
tpch_q18/duckdb:parquet 900600148 804674748 1.12
tpch_q19/duckdb:parquet 829966173 701086185 1.18
tpch_q20/duckdb:parquet 1115846683 958433158 1.16
tpch_q21/duckdb:parquet 1074752881 954396612 1.13
tpch_q22/duckdb:parquet 561351697 471961208 1.19
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +9.0% +10.1% -1.0% +68.7% ➖ noise
1 datafusion:vortex-file-compressed +50.3% +10.1% +36.5% +67.4% ➖ noise
1 duckdb:vortex-compact +18.7% +10.1% +7.7% +41.3% ➖ noise
1 duckdb:vortex-file-compressed +15.6% +10.1% +5.0% +32.6% ➖ noise
2 datafusion:vortex-compact +13.9% +21.0% -5.8% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +68.5% +21.0% +39.3% +37.7% 🚨 regression
2 duckdb:vortex-compact +13.1% +21.0% -6.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +27.7% +21.0% +5.5% +30.0% ➖ noise
3 datafusion:vortex-compact +7.0% +18.7% -9.8% +38.0% ➖ noise
3 datafusion:vortex-file-compressed +28.4% +18.7% +8.2% +53.8% ➖ noise
3 duckdb:vortex-compact +14.5% +18.7% -3.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +18.3% +18.7% -0.3% +30.0% ➖ noise
4 datafusion:vortex-compact +3.6% +26.0% -17.8% +32.8% ➖ noise
4 datafusion:vortex-file-compressed +1.5% +26.0% -19.4% +33.7% ➖ noise
4 duckdb:vortex-compact +8.9% +26.0% -13.5% +32.1% ➖ noise
4 duckdb:vortex-file-compressed +23.0% +26.0% -2.3% +30.0% ➖ noise
5 datafusion:vortex-compact +42.1% +12.2% +26.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +32.5% +12.2% +18.1% +30.0% ➖ noise
5 duckdb:vortex-compact +5.6% +12.2% -5.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +23.2% +12.2% +9.8% +30.0% ➖ noise
6 datafusion:vortex-compact +25.0% +7.2% +16.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -9.1% +7.2% -15.2% +30.0% ➖ noise
6 duckdb:vortex-compact +23.2% +7.2% +14.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +24.3% +7.2% +16.0% +30.0% ➖ noise
7 datafusion:vortex-compact +51.5% +19.8% +26.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +44.8% +19.8% +20.9% +30.0% ➖ noise
7 duckdb:vortex-compact -7.6% +19.8% -22.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.1% +19.8% -9.8% +30.0% ➖ noise
8 datafusion:vortex-compact +14.6% +7.0% +7.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +42.8% +7.0% +33.5% +30.0% 🚨 regression
8 duckdb:vortex-compact +15.4% +7.0% +7.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +9.0% +7.0% +1.9% +30.0% ➖ noise
9 datafusion:vortex-compact +8.3% +13.0% -4.2% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +30.9% +13.0% +15.8% +30.0% ➖ noise
9 duckdb:vortex-compact +8.9% +13.0% -3.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +5.3% +13.0% -6.8% +30.0% ➖ noise
10 datafusion:vortex-compact -0.8% +8.3% -8.4% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +24.4% +8.3% +14.9% +30.0% ➖ noise
10 duckdb:vortex-compact +11.3% +8.3% +2.8% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +3.6% +8.3% -4.3% +30.0% ➖ noise
11 datafusion:vortex-compact +5.6% +5.5% +0.1% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +21.7% +5.5% +15.4% +30.0% ➖ noise
11 duckdb:vortex-compact +23.3% +5.5% +16.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +12.3% +5.5% +6.5% +47.0% ➖ noise
12 datafusion:vortex-compact +32.5% +40.7% -5.8% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +12.2% +40.7% -20.2% +30.0% ➖ noise
12 duckdb:vortex-compact -14.9% +40.7% -39.5% +30.0% ✅ faster
12 duckdb:vortex-file-compressed -41.3% +40.7% -58.3% +33.1% ✅ faster
13 datafusion:vortex-compact +43.4% +9.2% +31.3% +43.0% ➖ noise
13 datafusion:vortex-file-compressed +5.9% +9.2% -3.0% +55.7% ➖ noise
13 duckdb:vortex-compact +1.5% +9.2% -7.1% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +1.6% +9.2% -7.0% +30.0% ➖ noise
14 datafusion:vortex-compact +60.0% +1.6% +57.4% +30.0% 🚨 regression
14 datafusion:vortex-file-compressed -9.4% +1.6% -10.8% +30.0% ➖ noise
14 duckdb:vortex-compact +20.1% +1.6% +18.2% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +8.0% +1.6% +6.3% +30.0% ➖ noise
15 datafusion:vortex-compact +45.4% +9.5% +32.7% +30.0% 🚨 regression
15 datafusion:vortex-file-compressed +2.2% +9.5% -6.7% +30.0% ➖ noise
15 duckdb:vortex-compact +38.1% +9.5% +26.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +20.4% +9.5% +9.9% +30.0% ➖ noise
16 datafusion:vortex-compact +34.8% +16.1% +16.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +29.6% +16.1% +11.6% +30.0% ➖ noise
16 duckdb:vortex-compact +12.6% +16.1% -3.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +15.8% +16.1% -0.3% +30.0% ➖ noise
17 datafusion:vortex-compact +20.7% +19.8% +0.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +98.0% +19.8% +65.3% +30.0% 🚨 regression
17 duckdb:vortex-compact +14.6% +19.8% -4.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +11.9% +19.8% -6.6% +30.0% ➖ noise
18 datafusion:vortex-compact +21.7% +10.7% +9.9% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +45.4% +10.7% +31.3% +30.0% 🚨 regression
18 duckdb:vortex-compact +19.1% +10.7% +7.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +26.0% +10.7% +13.8% +30.0% ➖ noise
19 datafusion:vortex-compact +24.2% +17.7% +5.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +36.0% +17.7% +15.6% +30.0% ➖ noise
19 duckdb:vortex-compact +11.6% +17.7% -5.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +23.5% +17.7% +4.9% +30.0% ➖ noise
20 datafusion:vortex-compact +5.7% +28.8% -18.0% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +5.1% +28.8% -18.4% +30.0% ➖ noise
20 duckdb:vortex-compact +7.5% +28.8% -16.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +5.8% +28.8% -17.9% +30.0% ➖ noise
21 datafusion:vortex-compact +13.7% +31.6% -13.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +26.4% +31.6% -4.0% +30.0% ➖ noise
21 duckdb:vortex-compact +29.8% +31.6% -1.4% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +23.9% +31.6% -5.9% +30.0% ➖ noise
22 datafusion:vortex-compact -4.9% +30.8% -27.3% +32.9% ✅ faster
22 datafusion:vortex-file-compressed +40.0% +30.8% +7.0% +40.3% ➖ noise
22 duckdb:vortex-compact +41.3% +30.8% +8.0% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +37.0% +30.8% +4.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.6%
Vortex (geomean): 0.869x ✅
Parquet (geomean): 0.931x ➖
Shifts: Parquet (control) -6.9% · Median polish -11.5%

datafusion / vortex-file-compressed (0.836x ✅, 21↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 393710637 432260347 0.91
tpch_q02/datafusion:vortex-file-compressed 🚀 107032898 121273080 0.88
tpch_q03/datafusion:vortex-file-compressed 🚀 208394233 247457468 0.84
tpch_q04/datafusion:vortex-file-compressed 🚀 109652597 134038433 0.82
tpch_q05/datafusion:vortex-file-compressed 🚀 363919766 438708428 0.83
tpch_q06/datafusion:vortex-file-compressed 🚀 35944976 48125357 0.75
tpch_q07/datafusion:vortex-file-compressed 🚀 490063756 577202817 0.85
tpch_q08/datafusion:vortex-file-compressed 🚀 350088352 421856058 0.83
tpch_q09/datafusion:vortex-file-compressed 🚀 612302855 722428257 0.85
tpch_q10/datafusion:vortex-file-compressed 🚀 223363539 263161307 0.85
tpch_q11/datafusion:vortex-file-compressed 🚀 79039741 92325968 0.86
tpch_q12/datafusion:vortex-file-compressed 🚀 113393012 134136051 0.85
tpch_q13/datafusion:vortex-file-compressed 🚀 209815424 243373796 0.86
tpch_q14/datafusion:vortex-file-compressed 🚀 50957083 63681985 0.80
tpch_q15/datafusion:vortex-file-compressed 🚀 95206953 119525914 0.80
tpch_q16/datafusion:vortex-file-compressed 🚀 75572373 85278047 0.89
tpch_q17/datafusion:vortex-file-compressed 🚀 613384939 726918056 0.84
tpch_q18/datafusion:vortex-file-compressed 🚀 820135882 977496471 0.84
tpch_q19/datafusion:vortex-file-compressed 🚀 70542990 98297827 0.72
tpch_q20/datafusion:vortex-file-compressed 🚀 157905236 187506511 0.84
tpch_q21/datafusion:vortex-file-compressed 🚀 642199729 757411444 0.85
tpch_q22/datafusion:vortex-file-compressed 🚀 63832380 73713790 0.87
datafusion / vortex-compact (0.867x ✅, 20↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 428682816 479564906 0.89
tpch_q02/datafusion:vortex-compact 🚀 106191040 120971766 0.88
tpch_q03/datafusion:vortex-compact 🚀 211617244 241062098 0.88
tpch_q04/datafusion:vortex-compact 🚀 117523663 132272707 0.89
tpch_q05/datafusion:vortex-compact 🚀 367667445 426199570 0.86
tpch_q06/datafusion:vortex-compact 🚀 57551146 70938068 0.81
tpch_q07/datafusion:vortex-compact 🚀 505402132 589596127 0.86
tpch_q08/datafusion:vortex-compact 🚀 354042797 405427152 0.87
tpch_q09/datafusion:vortex-compact 🚀 624499168 739966381 0.84
tpch_q10/datafusion:vortex-compact 🚀 236581199 270031118 0.88
tpch_q11/datafusion:vortex-compact 🚀 81792528 93026425 0.88
tpch_q12/datafusion:vortex-compact 🚀 156504794 181640285 0.86
tpch_q13/datafusion:vortex-compact 🚀 260500820 299749897 0.87
tpch_q14/datafusion:vortex-compact 🚀 68855535 82229727 0.84
tpch_q15/datafusion:vortex-compact 🚀 151802038 183611634 0.83
tpch_q16/datafusion:vortex-compact 78558308 85029760 0.92
tpch_q17/datafusion:vortex-compact 🚀 624771813 721578230 0.87
tpch_q18/datafusion:vortex-compact 🚀 823344069 961270253 0.86
tpch_q19/datafusion:vortex-compact 🚀 123151435 139571420 0.88
tpch_q20/datafusion:vortex-compact 🚀 181813869 217861989 0.83
tpch_q21/datafusion:vortex-compact 🚀 646813303 764612406 0.85
tpch_q22/datafusion:vortex-compact 70786994 75493250 0.94
datafusion / parquet (0.901x ➖, 10↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 462632268 524097621 0.88
tpch_q02/datafusion:parquet 168284192 186980940 0.90
tpch_q03/datafusion:parquet 🚀 275795220 309709869 0.89
tpch_q04/datafusion:parquet 123648926 134900949 0.92
tpch_q05/datafusion:parquet 🚀 424013455 480435865 0.88
tpch_q06/datafusion:parquet 121643921 131260541 0.93
tpch_q07/datafusion:parquet 🚀 591805180 677619956 0.87
tpch_q08/datafusion:parquet 🚀 445940730 524698856 0.85
tpch_q09/datafusion:parquet 🚀 725579503 831837204 0.87
tpch_q10/datafusion:parquet 487779812 539583193 0.90
tpch_q11/datafusion:parquet 114757260 125520922 0.91
tpch_q12/datafusion:parquet 189799446 205157525 0.93
tpch_q13/datafusion:parquet 329960422 351542757 0.94
tpch_q14/datafusion:parquet 155962941 166298282 0.94
tpch_q15/datafusion:parquet 🚀 239853445 269533023 0.89
tpch_q16/datafusion:parquet 123988772 132928454 0.93
tpch_q17/datafusion:parquet 🚀 666741459 767300081 0.87
tpch_q18/datafusion:parquet 🚀 854948516 971564279 0.88
tpch_q19/datafusion:parquet 250983373 273705520 0.92
tpch_q20/datafusion:parquet 282876732 307105754 0.92
tpch_q21/datafusion:parquet 🚀 672247983 779260253 0.86
tpch_q22/datafusion:parquet 212776393 224840996 0.95
datafusion / arrow (0.861x ✅, 20↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 587038576 669815325 0.88
tpch_q02/datafusion:arrow 🚀 161644413 182735624 0.88
tpch_q03/datafusion:arrow 🚀 455180102 532371869 0.86
tpch_q04/datafusion:arrow 🚀 333167015 397599694 0.84
tpch_q05/datafusion:arrow 🚀 925209924 1051454023 0.88
tpch_q06/datafusion:arrow 🚀 273349045 315388771 0.87
tpch_q07/datafusion:arrow 🚀 1128710316 1303069687 0.87
tpch_q08/datafusion:arrow 🚀 1114597066 1273785867 0.88
tpch_q09/datafusion:arrow 🚀 1323099771 1504847962 0.88
tpch_q10/datafusion:arrow 🚀 583442000 672205914 0.87
tpch_q11/datafusion:arrow 136959378 148169851 0.92
tpch_q12/datafusion:arrow 🚀 675212273 1033712920 0.65
tpch_q13/datafusion:arrow 🚀 484928161 544985974 0.89
tpch_q14/datafusion:arrow 🚀 315544015 364172393 0.87
tpch_q15/datafusion:arrow 🚀 674298025 805456241 0.84
tpch_q16/datafusion:arrow 🚀 103301156 120700001 0.86
tpch_q17/datafusion:arrow 🚀 1302305092 1513343547 0.86
tpch_q18/datafusion:arrow 🚀 1847623791 2138839239 0.86
tpch_q19/datafusion:arrow 🚀 475062153 539765633 0.88
tpch_q20/datafusion:arrow 🚀 472685315 547983099 0.86
tpch_q21/datafusion:arrow 2969808144 3253980515 0.91
tpch_q22/datafusion:arrow 🚀 127587307 145989514 0.87
duckdb / vortex-file-compressed (0.870x ✅, 14↑ 1↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171456756 186143026 0.92
tpch_q02/duckdb:vortex-file-compressed 🚀 48745360 55100236 0.88
tpch_q03/duckdb:vortex-file-compressed 🚀 123892127 142979863 0.87
tpch_q04/duckdb:vortex-file-compressed 🚀 151290862 191758178 0.79
tpch_q05/duckdb:vortex-file-compressed 🚀 124955371 166702441 0.75
tpch_q06/duckdb:vortex-file-compressed 🚨 42588163 35912737 1.19
tpch_q07/duckdb:vortex-file-compressed 🚀 137193988 175483158 0.78
tpch_q08/duckdb:vortex-file-compressed 🚀 166419045 185150003 0.90
tpch_q09/duckdb:vortex-file-compressed 🚀 317242678 454132581 0.70
tpch_q10/duckdb:vortex-file-compressed 🚀 140488936 205590958 0.68
tpch_q11/duckdb:vortex-file-compressed 🚀 31771523 35744487 0.89
tpch_q12/duckdb:vortex-file-compressed 🚀 91649838 111666880 0.82
tpch_q13/duckdb:vortex-file-compressed 🚀 222907497 251832400 0.89
tpch_q14/duckdb:vortex-file-compressed 58847362 62780924 0.94
tpch_q15/duckdb:vortex-file-compressed 🚀 86902332 97878419 0.89
tpch_q16/duckdb:vortex-file-compressed 77359883 79576610 0.97
tpch_q17/duckdb:vortex-file-compressed 🚀 92354743 112249522 0.82
tpch_q18/duckdb:vortex-file-compressed 289229037 310656610 0.93
tpch_q19/duckdb:vortex-file-compressed 82906437 87753761 0.94
tpch_q20/duckdb:vortex-file-compressed 🚀 144870992 182679198 0.79
tpch_q21/duckdb:vortex-file-compressed 543797144 575076626 0.95
tpch_q22/duckdb:vortex-file-compressed 69147413 69497494 0.99
duckdb / vortex-compact (0.907x ➖, 13↑ 3↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229525669 240632013 0.95
tpch_q02/duckdb:vortex-compact 🚀 53431176 63080047 0.85
tpch_q03/duckdb:vortex-compact 🚀 136603977 155651024 0.88
tpch_q04/duckdb:vortex-compact 🚀 168886366 196483795 0.86
tpch_q05/duckdb:vortex-compact 🚀 141157851 205410211 0.69
tpch_q06/duckdb:vortex-compact 🚨 77655632 61314675 1.27
tpch_q07/duckdb:vortex-compact 🚀 183025053 217461636 0.84
tpch_q08/duckdb:vortex-compact 🚀 183906861 205624363 0.89
tpch_q09/duckdb:vortex-compact 🚀 344604957 488587869 0.71
tpch_q10/duckdb:vortex-compact 🚀 172350948 231353817 0.74
tpch_q11/duckdb:vortex-compact 🚀 36892557 42932624 0.86
tpch_q12/duckdb:vortex-compact 🚨 198883985 174280539 1.14
tpch_q13/duckdb:vortex-compact 🚀 269194006 306985706 0.88
tpch_q14/duckdb:vortex-compact 🚨 92598249 82753348 1.12
tpch_q15/duckdb:vortex-compact 🚀 111107782 123902318 0.90
tpch_q16/duckdb:vortex-compact 82924083 82541658 1.00
tpch_q17/duckdb:vortex-compact 🚀 105440066 124531597 0.85
tpch_q18/duckdb:vortex-compact 289508723 309692830 0.93
tpch_q19/duckdb:vortex-compact 106162206 107186156 0.99
tpch_q20/duckdb:vortex-compact 🚀 177673133 225030984 0.79
tpch_q21/duckdb:vortex-compact 595531927 594660921 1.00
tpch_q22/duckdb:vortex-compact 81028771 78896944 1.03
duckdb / parquet (0.962x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 261202078 266246163 0.98
tpch_q02/duckdb:parquet 98256595 96576266 1.02
tpch_q03/duckdb:parquet 205132096 218148679 0.94
tpch_q04/duckdb:parquet 129903640 138005004 0.94
tpch_q05/duckdb:parquet 214880719 224591862 0.96
tpch_q06/duckdb:parquet 67902308 69339068 0.98
tpch_q07/duckdb:parquet 178778967 194207243 0.92
tpch_q08/duckdb:parquet 250810355 264589562 0.95
tpch_q09/duckdb:parquet 492380981 523332559 0.94
tpch_q10/duckdb:parquet 608922738 630325743 0.97
tpch_q11/duckdb:parquet 57464625 56102588 1.02
tpch_q12/duckdb:parquet 123096481 129817387 0.95
tpch_q13/duckdb:parquet 442823474 458499333 0.97
tpch_q14/duckdb:parquet 176534422 180477084 0.98
tpch_q15/duckdb:parquet 96493193 100736172 0.96
tpch_q16/duckdb:parquet 161722476 167952259 0.96
tpch_q17/duckdb:parquet 173358341 177504939 0.98
tpch_q18/duckdb:parquet 352752409 371519356 0.95
tpch_q19/duckdb:parquet 284649117 295803626 0.96
tpch_q20/duckdb:parquet 229484025 232373724 0.99
tpch_q21/duckdb:parquet 553184087 610299439 0.91
tpch_q22/duckdb:parquet 287907802 296827840 0.97
duckdb / duckdb (0.939x ➖, 1↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116713356 122841172 0.95
tpch_q02/duckdb:duckdb 49022525 48049391 1.02
tpch_q03/duckdb:duckdb 97309110 102779164 0.95
tpch_q04/duckdb:duckdb 132106832 143268563 0.92
tpch_q05/duckdb:duckdb 109677205 116675841 0.94
tpch_q06/duckdb:duckdb 🚀 37068500 42015474 0.88
tpch_q07/duckdb:duckdb 86328928 93397263 0.92
tpch_q08/duckdb:duckdb 110355661 119355092 0.92
tpch_q09/duckdb:duckdb 276311291 299209509 0.92
tpch_q10/duckdb:duckdb 203287034 220640616 0.92
tpch_q11/duckdb:duckdb 15440984 16405773 0.94
tpch_q12/duckdb:duckdb 84825015 90676676 0.94
tpch_q13/duckdb:duckdb 219024168 240554857 0.91
tpch_q14/duckdb:duckdb 70705308 74794690 0.95
tpch_q15/duckdb:duckdb 77235599 84271410 0.92
tpch_q16/duckdb:duckdb 74168458 77510979 0.96
tpch_q17/duckdb:duckdb 85050143 87837917 0.97
tpch_q18/duckdb:duckdb 211627436 225898104 0.94
tpch_q19/duckdb:duckdb 115921241 124607030 0.93
tpch_q20/duckdb:duckdb 112369343 117926191 0.95
tpch_q21/duckdb:duckdb 298163381 318503480 0.94
tpch_q22/duckdb:duckdb 67286133 68194618 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -12.4% -6.9% -5.8% +10.0% ➖ noise
1 datafusion:vortex-compact -10.6% -6.9% -3.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -8.9% -6.9% -2.1% +10.0% ➖ noise
1 duckdb:duckdb -5.0% -6.9% +2.1% +10.0% ➖ noise
1 duckdb:vortex-compact -4.6% -6.9% +2.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -7.9% -6.9% -1.0% +10.0% ➖ noise
2 datafusion:arrow -11.5% -4.3% -7.6% +10.0% ➖ noise
2 datafusion:vortex-compact -12.2% -4.3% -8.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -11.7% -4.3% -7.8% +10.0% ➖ noise
2 duckdb:duckdb +2.0% -4.3% +6.6% +10.0% ➖ noise
2 duckdb:vortex-compact -15.3% -4.3% -11.5% +10.0% ✅ faster
2 duckdb:vortex-file-compressed -11.5% -4.3% -7.5% +10.0% ➖ noise
3 datafusion:arrow -14.5% -8.5% -6.6% +10.0% ➖ noise
3 datafusion:vortex-compact -12.2% -8.5% -4.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -15.8% -8.5% -8.0% +10.0% ➖ noise
3 duckdb:duckdb -5.3% -8.5% +3.5% +10.0% ➖ noise
3 duckdb:vortex-compact -12.2% -8.5% -4.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -13.3% -8.5% -5.3% +10.0% ➖ noise
4 datafusion:arrow -16.2% -7.1% -9.8% +10.0% ✅ faster
4 datafusion:vortex-compact -11.2% -7.1% -4.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -18.2% -7.1% -11.9% +10.0% ✅ faster
4 duckdb:duckdb -7.8% -7.1% -0.7% +10.0% ➖ noise
4 duckdb:vortex-compact -14.0% -7.1% -7.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -21.1% -7.1% -15.1% +10.0% ✅ faster
5 datafusion:arrow -12.0% -8.1% -4.2% +10.0% ➖ noise
5 datafusion:vortex-compact -13.7% -8.1% -6.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -17.0% -8.1% -9.7% +10.0% ✅ faster
5 duckdb:duckdb -6.0% -8.1% +2.3% +10.0% ➖ noise
5 duckdb:vortex-compact -31.3% -8.1% -25.2% +10.0% ✅ faster
5 duckdb:vortex-file-compressed -25.0% -8.1% -18.4% +10.0% ✅ faster
6 datafusion:arrow -13.3% -4.7% -9.0% +10.0% ➖ noise
6 datafusion:vortex-compact -18.9% -4.7% -14.8% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -25.3% -4.7% -21.6% +10.0% ✅ faster
6 duckdb:duckdb -11.8% -4.7% -7.4% +11.6% ➖ noise
6 duckdb:vortex-compact +26.7% -4.7% +32.9% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +18.6% -4.7% +24.5% +11.6% 🚨 regression
7 datafusion:arrow -13.4% -10.3% -3.4% +10.0% ➖ noise
7 datafusion:vortex-compact -14.3% -10.3% -4.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -15.1% -10.3% -5.3% +10.0% ➖ noise
7 duckdb:duckdb -7.6% -10.3% +3.1% +10.0% ➖ noise
7 duckdb:vortex-compact -15.8% -10.3% -6.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -21.8% -10.3% -12.8% +10.0% ✅ faster
8 datafusion:arrow -12.5% -10.2% -2.5% +10.0% ➖ noise
8 datafusion:vortex-compact -12.7% -10.2% -2.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -17.0% -10.2% -7.5% +10.0% ➖ noise
8 duckdb:duckdb -7.5% -10.2% +3.0% +10.0% ➖ noise
8 duckdb:vortex-compact -10.6% -10.2% -0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -10.1% -10.2% +0.1% +10.0% ➖ noise
9 datafusion:arrow -12.1% -9.4% -2.9% +10.0% ➖ noise
9 datafusion:vortex-compact -15.6% -9.4% -6.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -15.2% -9.4% -6.4% +10.0% ➖ noise
9 duckdb:duckdb -7.7% -9.4% +1.9% +10.0% ➖ noise
9 duckdb:vortex-compact -29.5% -9.4% -22.1% +10.0% ✅ faster
9 duckdb:vortex-file-compressed -30.1% -9.4% -22.9% +10.0% ✅ faster
10 datafusion:arrow -13.2% -6.5% -7.1% +10.0% ➖ noise
10 datafusion:vortex-compact -12.4% -6.5% -6.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -15.1% -6.5% -9.2% +10.0% ✅ faster
10 duckdb:duckdb -7.9% -6.5% -1.4% +10.0% ➖ noise
10 duckdb:vortex-compact -25.5% -6.5% -20.3% +10.0% ✅ faster
10 duckdb:vortex-file-compressed -31.7% -6.5% -26.9% +10.0% ✅ faster
11 datafusion:arrow -7.6% -3.2% -4.5% +10.1% ➖ noise
11 datafusion:vortex-compact -12.1% -3.2% -9.1% +10.0% ✅ faster
11 datafusion:vortex-file-compressed -14.4% -3.2% -11.5% +10.0% ✅ faster
11 duckdb:duckdb -5.9% -3.2% -2.7% +12.0% ➖ noise
11 duckdb:vortex-compact -14.1% -3.2% -11.2% +10.0% ✅ faster
11 duckdb:vortex-file-compressed -11.1% -3.2% -8.1% +11.8% ➖ noise
12 datafusion:arrow -34.7% -6.3% -30.3% +30.7% ✅ faster
12 datafusion:vortex-compact -13.8% -6.3% -8.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -15.5% -6.3% -9.7% +10.0% ✅ faster
12 duckdb:duckdb -6.5% -6.3% -0.1% +10.0% ➖ noise
12 duckdb:vortex-compact +14.1% -6.3% +21.8% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed -17.9% -6.3% -12.4% +10.0% ✅ faster
13 datafusion:arrow -11.0% -4.8% -6.5% +10.0% ➖ noise
13 datafusion:vortex-compact -13.1% -4.8% -8.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -13.8% -4.8% -9.5% +10.0% ✅ faster
13 duckdb:duckdb -9.0% -4.8% -4.4% +10.0% ➖ noise
13 duckdb:vortex-compact -12.3% -4.8% -7.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -11.5% -4.8% -7.0% +10.0% ➖ noise
14 datafusion:arrow -13.4% -4.2% -9.5% +10.0% ✅ faster
14 datafusion:vortex-compact -16.3% -4.2% -12.6% +10.0% ✅ faster
14 datafusion:vortex-file-compressed -20.0% -4.2% -16.5% +10.0% ✅ faster
14 duckdb:duckdb -5.5% -4.2% -1.3% +10.0% ➖ noise
14 duckdb:vortex-compact +11.9% -4.2% +16.8% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed -6.3% -4.2% -2.1% +10.0% ➖ noise
15 datafusion:arrow -16.3% -7.7% -9.3% +10.0% ✅ faster
15 datafusion:vortex-compact -17.3% -7.7% -10.5% +10.0% ✅ faster
15 datafusion:vortex-file-compressed -20.3% -7.7% -13.7% +10.0% ✅ faster
15 duckdb:duckdb -8.3% -7.7% -0.7% +10.0% ➖ noise
15 duckdb:vortex-compact -10.3% -7.7% -2.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -11.2% -7.7% -3.8% +10.0% ➖ noise
16 datafusion:arrow -14.4% -5.2% -9.7% +10.0% ✅ faster
16 datafusion:vortex-compact -7.6% -5.2% -2.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -11.4% -5.2% -6.5% +10.0% ➖ noise
16 duckdb:duckdb -4.3% -5.2% +1.0% +10.0% ➖ noise
16 duckdb:vortex-compact +0.5% -5.2% +6.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.8% -5.2% +2.6% +10.0% ➖ noise
17 datafusion:arrow -13.9% -7.9% -6.6% +10.0% ➖ noise
17 datafusion:vortex-compact -13.4% -7.9% -6.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -15.6% -7.9% -8.4% +10.0% ➖ noise
17 duckdb:duckdb -3.2% -7.9% +5.1% +10.0% ➖ noise
17 duckdb:vortex-compact -15.3% -7.9% -8.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -17.7% -7.9% -10.7% +10.0% ✅ faster
18 datafusion:arrow -13.6% -8.6% -5.5% +10.0% ➖ noise
18 datafusion:vortex-compact -14.3% -8.6% -6.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -16.1% -8.6% -8.2% +10.0% ➖ noise
18 duckdb:duckdb -6.3% -8.6% +2.5% +10.0% ➖ noise
18 duckdb:vortex-compact -6.5% -8.6% +2.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -6.9% -8.6% +1.9% +10.0% ➖ noise
19 datafusion:arrow -12.0% -6.1% -6.3% +10.0% ➖ noise
19 datafusion:vortex-compact -11.8% -6.1% -6.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -28.2% -6.1% -23.6% +10.0% ✅ faster
19 duckdb:duckdb -7.0% -6.1% -1.0% +10.0% ➖ noise
19 duckdb:vortex-compact -1.0% -6.1% +5.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -5.5% -6.1% +0.6% +10.0% ➖ noise
20 datafusion:arrow -13.7% -4.6% -9.6% +10.0% ✅ faster
20 datafusion:vortex-compact -16.5% -4.6% -12.5% +10.0% ✅ faster
20 datafusion:vortex-file-compressed -15.8% -4.6% -11.7% +10.0% ✅ faster
20 duckdb:duckdb -4.7% -4.6% -0.1% +10.0% ➖ noise
20 duckdb:vortex-compact -21.0% -4.6% -17.2% +10.0% ✅ faster
20 duckdb:vortex-file-compressed -20.7% -4.6% -16.9% +10.0% ✅ faster
21 datafusion:arrow -8.7% -11.6% +3.2% +10.0% ➖ noise
21 datafusion:vortex-compact -15.4% -11.6% -4.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -15.2% -11.6% -4.1% +10.0% ➖ noise
21 duckdb:duckdb -6.4% -11.6% +5.9% +10.0% ➖ noise
21 duckdb:vortex-compact +0.1% -11.6% +13.3% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed -5.4% -11.6% +6.9% +10.0% ➖ noise
22 datafusion:arrow -12.6% -4.2% -8.8% +10.0% ➖ noise
22 datafusion:vortex-compact -6.2% -4.2% -2.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -13.4% -4.2% -9.6% +10.0% ✅ faster
22 duckdb:duckdb -1.3% -4.2% +3.0% +10.0% ➖ noise
22 duckdb:vortex-compact +2.7% -4.2% +7.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.5% -4.2% +3.9% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: Compression

Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.990x ➖

unknown / unknown (0.986x ➖, 6↑ 0↓)
name PR ea3e0db (ns) base 13c06b8 (ns) ratio (PR/base)
compress time/Arade 1115112544 1166768752 0.96
compress time/Bimbo 6758267618 7060949198 0.96
compress time/CMSprovider 2863225090 2891952149 0.99
compress time/Euro2016 412183477 429840556 0.96
compress time/Food 365307990 395552994 0.92
compress time/HashTags 824944667 817134443 1.01
compress time/TPC-H l_comment canonical 1271087490 1276633873 1.00
compress time/TPC-H l_comment chunked 1255322517 1294308753 0.97
compress time/taxi 716308778 726979460 0.99
compress time/wide table cols=100 chunks=1 rows=1000 🚀 11218086 12744114 0.88
compress time/wide table cols=100 chunks=50 rows=1000 11648936 11957045 0.97
compress time/wide table cols=1000 chunks=1 rows=1000 🚀 122482919 136620732 0.90
compress time/wide table cols=1000 chunks=50 rows=1000 125292398 128864136 0.97
compress time/wide table cols=10000 chunks=1 rows=1000 1439661877 1455550885 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1440281719 1432470290 1.01
decompress time/Arade 26296094 25062416 1.05
decompress time/Bimbo 🚀 77830093 88092112 0.88
decompress time/CMSprovider 76548508 77685537 0.99
decompress time/Euro2016 17057766 17918094 0.95
decompress time/Food 8272245 7777148 1.06
decompress time/HashTags 71918932 70580488 1.02
decompress time/TPC-H l_comment canonical 39675482 38731898 1.02
decompress time/TPC-H l_comment chunked 40037208 40711147 0.98
decompress time/taxi 14636906 15177658 0.96
decompress time/wide table cols=100 chunks=1 rows=1000 2382524 2519870 0.95
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2417538 2720150 0.89
decompress time/wide table cols=1000 chunks=1 rows=1000 22975980 23697057 0.97
decompress time/wide table cols=1000 chunks=50 rows=1000 22839814 23185274 0.99
decompress time/wide table cols=10000 chunks=1 rows=1000 251106382 254805925 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 242788601 256812299 0.95
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2592469553 2606614852 0.99
parquet_rs-zstd compress time/Bimbo 12730694964 12874741854 0.99
parquet_rs-zstd compress time/CMSprovider 6707689918 6885581515 0.97
parquet_rs-zstd compress time/Euro2016 1282399416 1288403412 1.00
parquet_rs-zstd compress time/Food 798963666 792058592 1.01
parquet_rs-zstd compress time/HashTags 2103783376 2172309826 0.97
parquet_rs-zstd compress time/TPC-H l_comment canonical 3124401432 3169025959 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3147252212 3182384588 0.99
parquet_rs-zstd compress time/taxi 1216139948 1182441878 1.03
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6041658 6091607 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6026531 6392446 0.94
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 74461743 76359005 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 75064710 77473284 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 773815075 782854941 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 770412356 782847565 0.98
parquet_rs-zstd decompress time/Arade 616827520 617016184 1.00
parquet_rs-zstd decompress time/Bimbo 1681611431 1677749958 1.00
parquet_rs-zstd decompress time/CMSprovider 1670309600 1701028974 0.98
parquet_rs-zstd decompress time/Euro2016 368734258 372687420 0.99
parquet_rs-zstd decompress time/Food 197837735 197973361 1.00
parquet_rs-zstd decompress time/HashTags 615331118 624638641 0.99
parquet_rs-zstd decompress time/TPC-H l_comment canonical 582200808 593162945 0.98
parquet_rs-zstd decompress time/TPC-H l_comment chunked 584122566 587043070 1.00
parquet_rs-zstd decompress time/taxi 248454365 242828994 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2782710 2810813 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2774410 2852856 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32454387 32184449 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32834027 32794188 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 345606867 343975919 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 342652390 351182332 0.98
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163497796 163757340 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.96
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.96
vortex:parquet-zstd ratio compress time/Food 0 0 0.92
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.96
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 2 0.89
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.05
vortex:parquet-zstd ratio decompress time/Bimbo 🚀 0 0 0.88
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.96
vortex:parquet-zstd ratio decompress time/Food 0 0 1.06
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -3.5%

datafusion / vortex-file-compressed (0.987x ➖, 0↑ 1↓)
name PR ea3e0db (ns) base 254f91b (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 767192338 757314297 1.01
tpch_q02/datafusion:vortex-file-compressed 1121618801 889893635 1.26
tpch_q03/datafusion:vortex-file-compressed 827468260 951979445 0.87
tpch_q04/datafusion:vortex-file-compressed 545676833 585699336 0.93
tpch_q05/datafusion:vortex-file-compressed 979245829 1021887180 0.96
tpch_q06/datafusion:vortex-file-compressed 626519607 717214414 0.87
tpch_q07/datafusion:vortex-file-compressed 1204594455 1122851522 1.07
tpch_q08/datafusion:vortex-file-compressed 1227217331 1129132592 1.09
tpch_q09/datafusion:vortex-file-compressed 1322879123 1351589007 0.98
tpch_q10/datafusion:vortex-file-compressed 974925934 989278705 0.99
tpch_q11/datafusion:vortex-file-compressed 582740814 574691832 1.01
tpch_q12/datafusion:vortex-file-compressed 936124865 1235202660 0.76
tpch_q13/datafusion:vortex-file-compressed 462691040 436959232 1.06
tpch_q14/datafusion:vortex-file-compressed 572224452 655325934 0.87
tpch_q15/datafusion:vortex-file-compressed 1021100782 1017494834 1.00
tpch_q16/datafusion:vortex-file-compressed 🚨 745708260 562226139 1.33
tpch_q17/datafusion:vortex-file-compressed 1307509737 1156597435 1.13
tpch_q18/datafusion:vortex-file-compressed 1317735842 1272368896 1.04
tpch_q19/datafusion:vortex-file-compressed 834571022 905542259 0.92
tpch_q20/datafusion:vortex-file-compressed 1095897499 1047748585 1.05
tpch_q21/datafusion:vortex-file-compressed 1728002234 1832595134 0.94
tpch_q22/datafusion:vortex-file-compressed 371524498 485232116 0.77
datafusion / vortex-compact (1.020x ➖, 0↑ 1↓)
name PR ea3e0db (ns) base 254f91b (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 699999535 697764944 1.00
tpch_q02/datafusion:vortex-compact 662463978 662774224 1.00
tpch_q03/datafusion:vortex-compact 776833730 752027357 1.03
tpch_q04/datafusion:vortex-compact 506212191 560628216 0.90
tpch_q05/datafusion:vortex-compact 968699018 911478548 1.06
tpch_q06/datafusion:vortex-compact 582844122 492133401 1.18
tpch_q07/datafusion:vortex-compact 994788424 1080779043 0.92
tpch_q08/datafusion:vortex-compact 1230890077 1279342601 0.96
tpch_q09/datafusion:vortex-compact 1310235814 1246637959 1.05
tpch_q10/datafusion:vortex-compact 914921016 875218945 1.05
tpch_q11/datafusion:vortex-compact 474774812 404392226 1.17
tpch_q12/datafusion:vortex-compact 730216613 712658979 1.02
tpch_q13/datafusion:vortex-compact 404319520 386704010 1.05
tpch_q14/datafusion:vortex-compact 497814292 481316594 1.03
tpch_q15/datafusion:vortex-compact 896047830 893900976 1.00
tpch_q16/datafusion:vortex-compact 370184291 436588366 0.85
tpch_q17/datafusion:vortex-compact 1178306010 1214876164 0.97
tpch_q18/datafusion:vortex-compact 1200990777 1203564925 1.00
tpch_q19/datafusion:vortex-compact 765852843 852500700 0.90
tpch_q20/datafusion:vortex-compact 808708407 897280793 0.90
tpch_q21/datafusion:vortex-compact 1456326237 1456462875 1.00
tpch_q22/datafusion:vortex-compact 🚨 744295836 480003714 1.55
datafusion / parquet (1.049x ➖, 0↑ 3↓)
name PR ea3e0db (ns) base 254f91b (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 841374427 856822200 0.98
tpch_q02/datafusion:parquet 🚨 1563860804 742290612 2.11
tpch_q03/datafusion:parquet 933295072 957105867 0.98
tpch_q04/datafusion:parquet 527669075 487860003 1.08
tpch_q05/datafusion:parquet 1244498305 1079336524 1.15
tpch_q06/datafusion:parquet 628332239 503083179 1.25
tpch_q07/datafusion:parquet 1435699102 1534074007 0.94
tpch_q08/datafusion:parquet 1566796670 2213865873 0.71
tpch_q09/datafusion:parquet 1709867320 2049499336 0.83
tpch_q10/datafusion:parquet 2060344814 2037616516 1.01
tpch_q11/datafusion:parquet 688796994 637308294 1.08
tpch_q12/datafusion:parquet 646063116 705231688 0.92
tpch_q13/datafusion:parquet 692021327 716510387 0.97
tpch_q14/datafusion:parquet 779858458 852916379 0.91
tpch_q15/datafusion:parquet 1364725987 1367257621 1.00
tpch_q16/datafusion:parquet 🚨 542701300 382314937 1.42
tpch_q17/datafusion:parquet 1321773541 1396539441 0.95
tpch_q18/datafusion:parquet 1527703750 1596355865 0.96
tpch_q19/datafusion:parquet 893110768 934004575 0.96
tpch_q20/datafusion:parquet 1224898631 1379279387 0.89
tpch_q21/datafusion:parquet 1718487311 1806624266 0.95
tpch_q22/datafusion:parquet 🚨 1166525549 653272702 1.79
duckdb / vortex-file-compressed (0.956x ➖, 1↑ 1↓)
name PR ea3e0db (ns) base 254f91b (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 589645190 602313690 0.98
tpch_q02/duckdb:vortex-file-compressed 1292191135 1432171260 0.90
tpch_q03/duckdb:vortex-file-compressed 901830869 1080403382 0.83
tpch_q04/duckdb:vortex-file-compressed 632457171 703780034 0.90
tpch_q05/duckdb:vortex-file-compressed 1110185520 1239474588 0.90
tpch_q06/duckdb:vortex-file-compressed 🚨 699837034 538229270 1.30
tpch_q07/duckdb:vortex-file-compressed 1203005979 1313088297 0.92
tpch_q08/duckdb:vortex-file-compressed 1452058918 1575618262 0.92
tpch_q09/duckdb:vortex-file-compressed 1497593567 1754803758 0.85
tpch_q10/duckdb:vortex-file-compressed 1130262213 1270022620 0.89
tpch_q11/duckdb:vortex-file-compressed 646843746 742643797 0.87
tpch_q12/duckdb:vortex-file-compressed 🚀 712636224 1302805128 0.55
tpch_q13/duckdb:vortex-file-compressed 1013345837 962842832 1.05
tpch_q14/duckdb:vortex-file-compressed 784662828 696579020 1.13
tpch_q15/duckdb:vortex-file-compressed 649984804 555469117 1.17
tpch_q16/duckdb:vortex-file-compressed 513178812 487053172 1.05
tpch_q17/duckdb:vortex-file-compressed 954424276 969744746 0.98
tpch_q18/duckdb:vortex-file-compressed 909156190 967416818 0.94
tpch_q19/duckdb:vortex-file-compressed 769892955 855920005 0.90
tpch_q20/duckdb:vortex-file-compressed 1232994935 1301287832 0.95
tpch_q21/duckdb:vortex-file-compressed 2033421049 1850519427 1.10
tpch_q22/duckdb:vortex-file-compressed 641165639 512398373 1.25
duckdb / vortex-compact (0.950x ➖, 1↑ 0↓)
name PR ea3e0db (ns) base 254f91b (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 576807625 630209868 0.92
tpch_q02/duckdb:vortex-compact 1074046267 1200983600 0.89
tpch_q03/duckdb:vortex-compact 846161999 859425263 0.98
tpch_q04/duckdb:vortex-compact 493313370 576370186 0.86
tpch_q05/duckdb:vortex-compact 1047290869 1256231310 0.83
tpch_q06/duckdb:vortex-compact 659173473 558122877 1.18
tpch_q07/duckdb:vortex-compact 1010006438 1210984102 0.83
tpch_q08/duckdb:vortex-compact 1424081211 1367731731 1.04
tpch_q09/duckdb:vortex-compact 1372012855 1481716976 0.93
tpch_q10/duckdb:vortex-compact 929446911 975254415 0.95
tpch_q11/duckdb:vortex-compact 643302633 711846247 0.90
tpch_q12/duckdb:vortex-compact 🚀 645363272 1112137490 0.58
tpch_q13/duckdb:vortex-compact 847734407 857253831 0.99
tpch_q14/duckdb:vortex-compact 772924615 680576249 1.14
tpch_q15/duckdb:vortex-compact 497823961 516039107 0.96
tpch_q16/duckdb:vortex-compact 484440666 425452262 1.14
tpch_q17/duckdb:vortex-compact 902169517 867663427 1.04
tpch_q18/duckdb:vortex-compact 772271806 850899529 0.91
tpch_q19/duckdb:vortex-compact 706271483 769197240 0.92
tpch_q20/duckdb:vortex-compact 1165847417 1194978378 0.98
tpch_q21/duckdb:vortex-compact 1638924324 1834935616 0.89
tpch_q22/duckdb:vortex-compact 606545048 471852388 1.29
duckdb / parquet (0.950x ➖, 0↑ 0↓)
name PR ea3e0db (ns) base 254f91b (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 808718647 861718251 0.94
tpch_q02/duckdb:parquet 1388428250 1460905146 0.95
tpch_q03/duckdb:parquet 1854316457 1899462683 0.98
tpch_q04/duckdb:parquet 866052961 1212491080 0.71
tpch_q05/duckdb:parquet 1799790668 2096058125 0.86
tpch_q06/duckdb:parquet 736716155 813311086 0.91
tpch_q07/duckdb:parquet 1989203526 1950851177 1.02
tpch_q08/duckdb:parquet 2312075875 2612390307 0.89
tpch_q09/duckdb:parquet 2715513106 2726071170 1.00
tpch_q10/duckdb:parquet 3287326746 3235436602 1.02
tpch_q11/duckdb:parquet 1006589005 1030935764 0.98
tpch_q12/duckdb:parquet 1486962613 1341481899 1.11
tpch_q13/duckdb:parquet 1321433850 1340611657 0.99
tpch_q14/duckdb:parquet 1274471609 1465382139 0.87
tpch_q15/duckdb:parquet 933289448 876667317 1.06
tpch_q16/duckdb:parquet 870401736 873760354 1.00
tpch_q17/duckdb:parquet 1359631309 1299547791 1.05
tpch_q18/duckdb:parquet 1371760993 1464057121 0.94
tpch_q19/duckdb:parquet 1495567057 1585802689 0.94
tpch_q20/duckdb:parquet 2170234371 2202909021 0.99
tpch_q21/duckdb:parquet 1740787492 1969816859 0.88
tpch_q22/duckdb:parquet 1058564146 1147694947 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.3% -4.0% +4.5% +49.3% ➖ noise
1 datafusion:vortex-file-compressed +1.3% -4.0% +5.5% +93.2% ➖ noise
1 duckdb:vortex-compact -8.5% -4.0% -4.7% +38.3% ➖ noise
1 duckdb:vortex-file-compressed -2.1% -4.0% +2.0% +39.3% ➖ noise
2 datafusion:vortex-compact -0.0% +41.5% -29.4% +57.2% ➖ noise
2 datafusion:vortex-file-compressed +26.0% +41.5% -10.9% +48.3% ➖ noise
2 duckdb:vortex-compact -10.6% +41.5% -36.8% +38.3% ✅ faster
2 duckdb:vortex-file-compressed -9.8% +41.5% -36.2% +38.3% ✅ faster
3 datafusion:vortex-compact +3.3% -2.4% +5.9% +52.4% ➖ noise
3 datafusion:vortex-file-compressed -13.1% -2.4% -10.9% +57.8% ➖ noise
3 duckdb:vortex-compact -1.5% -2.4% +0.9% +40.5% ➖ noise
3 duckdb:vortex-file-compressed -16.5% -2.4% -14.4% +45.5% ➖ noise
4 datafusion:vortex-compact -9.7% -12.1% +2.7% +38.3% ➖ noise
4 datafusion:vortex-file-compressed -6.8% -12.1% +6.0% +38.3% ➖ noise
4 duckdb:vortex-compact -14.4% -12.1% -2.6% +38.3% ➖ noise
4 duckdb:vortex-file-compressed -10.1% -12.1% +2.2% +38.3% ➖ noise
5 datafusion:vortex-compact +6.3% -0.5% +6.8% +38.3% ➖ noise
5 datafusion:vortex-file-compressed -4.2% -0.5% -3.7% +38.3% ➖ noise
5 duckdb:vortex-compact -16.6% -0.5% -16.2% +38.3% ➖ noise
5 duckdb:vortex-file-compressed -10.4% -0.5% -10.0% +38.3% ➖ noise
6 datafusion:vortex-compact +18.4% +6.4% +11.3% +38.3% ➖ noise
6 datafusion:vortex-file-compressed -12.6% +6.4% -17.9% +40.2% ➖ noise
6 duckdb:vortex-compact +18.1% +6.4% +11.0% +38.3% ➖ noise
6 duckdb:vortex-file-compressed +30.0% +6.4% +22.2% +38.3% ➖ noise
7 datafusion:vortex-compact -8.0% -2.3% -5.8% +38.3% ➖ noise
7 datafusion:vortex-file-compressed +7.3% -2.3% +9.8% +38.3% ➖ noise
7 duckdb:vortex-compact -16.6% -2.3% -14.6% +38.3% ➖ noise
7 duckdb:vortex-file-compressed -8.4% -2.3% -6.2% +38.3% ➖ noise
8 datafusion:vortex-compact -3.8% -20.9% +21.6% +38.3% ➖ noise
8 datafusion:vortex-file-compressed +8.7% -20.9% +37.3% +38.3% ➖ noise
8 duckdb:vortex-compact +4.1% -20.9% +31.6% +38.3% ➖ noise
8 duckdb:vortex-file-compressed -7.8% -20.9% +16.4% +38.3% ➖ noise
9 datafusion:vortex-compact +5.1% -8.8% +15.3% +38.3% ➖ noise
9 datafusion:vortex-file-compressed -2.1% -8.8% +7.4% +38.3% ➖ noise
9 duckdb:vortex-compact -7.4% -8.8% +1.6% +38.3% ➖ noise
9 duckdb:vortex-file-compressed -14.7% -8.8% -6.4% +38.3% ➖ noise
10 datafusion:vortex-compact +4.5% +1.4% +3.1% +38.3% ➖ noise
10 datafusion:vortex-file-compressed -1.5% +1.4% -2.8% +38.3% ➖ noise
10 duckdb:vortex-compact -4.7% +1.4% -6.0% +38.3% ➖ noise
10 duckdb:vortex-file-compressed -11.0% +1.4% -12.2% +38.3% ➖ noise
11 datafusion:vortex-compact +17.4% +2.7% +14.3% +38.3% ➖ noise
11 datafusion:vortex-file-compressed +1.4% +2.7% -1.3% +38.3% ➖ noise
11 duckdb:vortex-compact -9.6% +2.7% -12.0% +38.3% ➖ noise
11 duckdb:vortex-file-compressed -12.9% +2.7% -15.2% +38.3% ➖ noise
12 datafusion:vortex-compact +2.5% +0.8% +1.7% +38.3% ➖ noise
12 datafusion:vortex-file-compressed -24.2% +0.8% -24.8% +38.3% ➖ noise
12 duckdb:vortex-compact -42.0% +0.8% -42.4% +38.3% ✅ faster
12 duckdb:vortex-file-compressed -45.3% +0.8% -45.7% +38.3% ✅ faster
13 datafusion:vortex-compact +4.6% -2.4% +7.2% +38.3% ➖ noise
13 datafusion:vortex-file-compressed +5.9% -2.4% +8.5% +38.3% ➖ noise
13 duckdb:vortex-compact -1.1% -2.4% +1.4% +50.6% ➖ noise
13 duckdb:vortex-file-compressed +5.2% -2.4% +7.9% +44.2% ➖ noise
14 datafusion:vortex-compact +3.4% -10.8% +16.0% +38.3% ➖ noise
14 datafusion:vortex-file-compressed -12.7% -10.8% -2.1% +38.3% ➖ noise
14 duckdb:vortex-compact +13.6% -10.8% +27.4% +38.3% ➖ noise
14 duckdb:vortex-file-compressed +12.6% -10.8% +26.3% +38.3% ➖ noise
15 datafusion:vortex-compact +0.2% +3.1% -2.8% +38.3% ➖ noise
15 datafusion:vortex-file-compressed +0.4% +3.1% -2.6% +38.3% ➖ noise
15 duckdb:vortex-compact -3.5% +3.1% -6.4% +38.3% ➖ noise
15 duckdb:vortex-file-compressed +17.0% +3.1% +13.5% +38.3% ➖ noise
16 datafusion:vortex-compact -15.2% +18.9% -28.7% +48.7% ➖ noise
16 datafusion:vortex-file-compressed +32.6% +18.9% +11.5% +45.8% ➖ noise
16 duckdb:vortex-compact +13.9% +18.9% -4.2% +38.3% ➖ noise
16 duckdb:vortex-file-compressed +5.4% +18.9% -11.4% +38.3% ➖ noise
17 datafusion:vortex-compact -3.0% -0.5% -2.5% +38.3% ➖ noise
17 datafusion:vortex-file-compressed +13.0% -0.5% +13.6% +38.3% ➖ noise
17 duckdb:vortex-compact +4.0% -0.5% +4.5% +38.3% ➖ noise
17 duckdb:vortex-file-compressed -1.6% -0.5% -1.1% +38.3% ➖ noise
18 datafusion:vortex-compact -0.2% -5.3% +5.4% +38.3% ➖ noise
18 datafusion:vortex-file-compressed +3.6% -5.3% +9.4% +38.3% ➖ noise
18 duckdb:vortex-compact -9.2% -5.3% -4.2% +38.3% ➖ noise
18 duckdb:vortex-file-compressed -6.0% -5.3% -0.8% +38.3% ➖ noise
19 datafusion:vortex-compact -10.2% -5.0% -5.4% +38.3% ➖ noise
19 datafusion:vortex-file-compressed -7.8% -5.0% -2.9% +38.3% ➖ noise
19 duckdb:vortex-compact -8.2% -5.0% -3.3% +38.3% ➖ noise
19 duckdb:vortex-file-compressed -10.1% -5.0% -5.3% +38.3% ➖ noise
20 datafusion:vortex-compact -9.9% -6.5% -3.6% +38.3% ➖ noise
20 datafusion:vortex-file-compressed +4.6% -6.5% +11.8% +38.3% ➖ noise
20 duckdb:vortex-compact -2.4% -6.5% +4.3% +38.3% ➖ noise
20 duckdb:vortex-file-compressed -5.2% -6.5% +1.3% +38.3% ➖ noise
21 datafusion:vortex-compact -0.0% -8.3% +9.1% +38.3% ➖ noise
21 datafusion:vortex-file-compressed -5.7% -8.3% +2.8% +38.3% ➖ noise
21 duckdb:vortex-compact -10.7% -8.3% -2.6% +38.3% ➖ noise
21 duckdb:vortex-file-compressed +9.9% -8.3% +19.8% +38.3% ➖ noise
22 datafusion:vortex-compact +55.1% +28.3% +20.8% +38.3% ➖ noise
22 datafusion:vortex-file-compressed -23.4% +28.3% -40.3% +38.3% ✅ faster
22 duckdb:vortex-compact +28.5% +28.3% +0.2% +38.3% ➖ noise
22 duckdb:vortex-file-compressed +25.1% +28.3% -2.5% +38.3% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gatesn gatesn gatesn approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@joseph-isaacs @gatesn